-- Logs begin at Thu 2022-06-16 16:29:03 UTC, end at Thu 2022-06-16 18:00:36 UTC. -- Jun 16 17:15:39.167925 dv-cinder-837546-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 17:15:39.175391 dv-cinder-837546-2-smb devstack@keystone.service[80446]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 17:15:39.177422 dv-cinder-837546-2-smb devstack@keystone.service[80446]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 17:15:39 2022] *** Jun 16 17:15:39.177422 dv-cinder-837546-2-smb devstack@keystone.service[80446]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 17:15:39.177422 dv-cinder-837546-2-smb devstack@keystone.service[80446]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 17:15:39.177422 dv-cinder-837546-2-smb devstack@keystone.service[80446]: nodename: dv-cinder-837546-2-smb Jun 16 17:15:39.177422 dv-cinder-837546-2-smb devstack@keystone.service[80446]: machine: x86_64 Jun 16 17:15:39.177422 dv-cinder-837546-2-smb devstack@keystone.service[80446]: clock source: unix Jun 16 17:15:39.177838 dv-cinder-837546-2-smb devstack@keystone.service[80446]: pcre jit disabled Jun 16 17:15:39.177838 dv-cinder-837546-2-smb devstack@keystone.service[80446]: detected number of CPU cores: 4 Jun 16 17:15:39.177838 dv-cinder-837546-2-smb devstack@keystone.service[80446]: current working directory: / Jun 16 17:15:39.177838 dv-cinder-837546-2-smb devstack@keystone.service[80446]: detected binary path: /usr/bin/uwsgi-core Jun 16 17:15:39.177838 dv-cinder-837546-2-smb devstack@keystone.service[80446]: your processes number limit is 47680 Jun 16 17:15:39.177838 dv-cinder-837546-2-smb devstack@keystone.service[80446]: your memory page size is 4096 bytes Jun 16 17:15:39.177838 dv-cinder-837546-2-smb devstack@keystone.service[80446]: detected max file descriptor number: 2048 Jun 16 17:15:39.177838 dv-cinder-837546-2-smb devstack@keystone.service[80446]: lock engine: pthread robust mutexes Jun 16 17:15:39.177838 dv-cinder-837546-2-smb devstack@keystone.service[80446]: thunder lock: enabled Jun 16 17:15:39.177838 dv-cinder-837546-2-smb devstack@keystone.service[80446]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 17:15:39.178435 dv-cinder-837546-2-smb devstack@keystone.service[80446]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 17:15:39.223561 dv-cinder-837546-2-smb devstack@keystone.service[80446]: Python main interpreter initialized at 0x558b52e5a9c0 Jun 16 17:15:39.223561 dv-cinder-837546-2-smb devstack@keystone.service[80446]: python threads support enabled Jun 16 17:15:39.223561 dv-cinder-837546-2-smb devstack@keystone.service[80446]: your server socket listen backlog is limited to 100 connections Jun 16 17:15:39.223561 dv-cinder-837546-2-smb devstack@keystone.service[80446]: your mercy for graceful operations on workers is 90 seconds Jun 16 17:15:39.223934 dv-cinder-837546-2-smb devstack@keystone.service[80446]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 17:15:39.224010 dv-cinder-837546-2-smb devstack@keystone.service[80446]: *** Operational MODE: preforking *** Jun 16 17:15:39.224348 dv-cinder-837546-2-smb devstack@keystone.service[80446]: *** uWSGI is running in multiple interpreter mode *** Jun 16 17:15:39.224348 dv-cinder-837546-2-smb devstack@keystone.service[80446]: spawned uWSGI master process (pid: 80446) Jun 16 17:15:39.224556 dv-cinder-837546-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 17:15:39.225415 dv-cinder-837546-2-smb devstack@keystone.service[80446]: spawned uWSGI worker 1 (pid: 80456, cores: 1) Jun 16 17:15:39.225524 dv-cinder-837546-2-smb devstack@keystone.service[80446]: spawned uWSGI worker 2 (pid: 80457, cores: 1) Jun 16 17:15:39.225611 dv-cinder-837546-2-smb devstack@keystone.service[80446]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 17:15:44.810437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:15:44.810437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: from cryptography.utils import int_from_bytes Jun 16 17:15:44.811225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:15:44.811225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: from cryptography.utils import int_from_bytes Jun 16 17:15:44.811450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:15:44.811450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: from cryptography.utils import int_from_bytes Jun 16 17:15:44.811911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:15:44.811911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: from cryptography.utils import int_from_bytes Jun 16 17:15:44.861744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:15:44.861908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:15:44.862005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:15:44.862102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] command line args: [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:15:44.862186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:15:44.862267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] command line args: [] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:15:44.862346 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:15:44.862485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ================================================================================ {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:15:44.862574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:15:44.862697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ================================================================================ {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:15:44.862777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] admin_token = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.862973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] admin_token = **** {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.863070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] config_dir = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.863155 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.863233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] config_dir = [] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.863304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] config_source = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.863386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.863492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] debug = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.863618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] config_source = [] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.863709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.863930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] debug = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.863930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.864104 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.864186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.864290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.864366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.864528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.864614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.864714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.864829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.864939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] list_limit = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] log_config_append = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] log_config_append = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] log_dir = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] log_dir = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] log_file = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] log_file = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.865985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.866093 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.866200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.866284 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.866449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.866536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.866697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.866782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.866861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.866937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.867038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.867128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.867282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.867367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.867529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.867614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.867763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.867850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.867993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.868096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.868252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.871525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.871628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.871700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.871819 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.871906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.871983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] publish_errors = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] publish_errors = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.872964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] standard_threads = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873591 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] standard_threads = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.873965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] use_journal = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.874041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.874117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] use_json = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.874263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] use_journal = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.874343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] use_stderr = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.874420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] use_json = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.874498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] use_syslog = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.875099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] use_stderr = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.875213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.875301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] use_syslog = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.875363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.875420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:15:44.875482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.875545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.875603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.875670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.875729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.875790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.875848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.875903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876027 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876140 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876378 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.876953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877619 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.877984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.878062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.878145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.878222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.878506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.878597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.878678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.878750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.878827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.878899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.878978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879205 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879205 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879420 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879498 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879792 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.879987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.880174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.880256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.880406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.880482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.880637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.880717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.880869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.880953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.881114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.881191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.881347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.881433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.881585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.881662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.881815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.881902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.882049 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.882129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.882282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.882393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.882503 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.882607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.882712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.882810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.882939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.883044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.883167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.883273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.883391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.883520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.883668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.883797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.883917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.884030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.884170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.884295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.884411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.884525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.884638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.884752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.884875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.884998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.885114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.885228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.885332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.885444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.885562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.885686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.885808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.885931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.886036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.886154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.886270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.886382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.886502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.886624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.886739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.886859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.886966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.887088 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.887204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.887308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.887434 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.887551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.887673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.887788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.887911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.888033 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.888192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.888310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.888424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.888691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.888843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.888970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.889093 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.889211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.889335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.889531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.889651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.889766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.889888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.890003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.890125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.890318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.891040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.891237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.891346 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.891584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.891703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.891835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.891835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.892088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.892242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.892414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.892526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.892642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.893023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.893148 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.893265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.893385 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.893499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.893613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.893735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.893850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.893971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.894092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.894207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.894322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.894443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.894559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.894673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.894787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.894907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.895021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.895142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.895257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.895372 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.895494 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.895612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.895727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.895848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.895963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.896150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.896269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.896384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.896508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.896632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.896752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.896867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.896980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.897092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.897211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.897334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.897449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.897562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.897675 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.897795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.897909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.898030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.898151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.898265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.898378 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.898529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.898641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.898745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.898849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.898948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.899042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.899136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.899229 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.external = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.899334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] auth.external = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.899430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.899532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.899627 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.899749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.899858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.899956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.900051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.password = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.905846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] auth.password = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.905996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.token = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.906060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] auth.token = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.906132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.906260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.906389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.906462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.906523 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.906582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.906760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.906850 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.906924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] credential.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.907934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.908996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.909946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] federation.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910311 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910595 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.910976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911350 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.911971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.912960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.913992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.914996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915176 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915253 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915476 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.915987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916306 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916746 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.916965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917712 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917783 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.917996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918148 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918586 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918657 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.918949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919314 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919712 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919896 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.919953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920345 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.920909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.921059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.921140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.921295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.921383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.921644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.921987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.922336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.922592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.922844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.923090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.923335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.923415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.923598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.923684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.923816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.923904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.924065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.924164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.924324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.924403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.924561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.924652 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.924790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.924869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.925024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.925101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.925262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.925347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.925499 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.925578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.925733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.925810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.925964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.926118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.926193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.926264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.926434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.926518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.926667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.926753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.926899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.926977 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.927135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.927212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.927378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.927464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.927608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.927685 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.927836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.927913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.928111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.928206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.928331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] resource.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.928409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.928568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.928646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.928800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.928881 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.929035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.929114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.929273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.929351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.929520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.929601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.929753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.929830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.929986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.930064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.930221 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.930300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.930460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.930539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.930690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.930767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] role.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.930933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.931013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] role.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.931164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.931241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.931397 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.931475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.931627 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] role.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.931708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.931869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] role.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.931955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.932125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.932207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.932372 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.932495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.932620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.932740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.932855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.932970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.933096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.933212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.933326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.933440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.933553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.933666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.933787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.933904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.934017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.934132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.934246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.934359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.934481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.934647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.934766 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.934880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.934994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.935107 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.935231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.935346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.935564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.935682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.935796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.935918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.936033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.936206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.936321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.936434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.936548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.936673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.936789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.936903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.937016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.937635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.937768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.937954 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.938065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.938169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.938287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.938403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.938516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.938639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.938763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.938878 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.938991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.939104 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.939218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.939340 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.939457 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.939570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.939684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.939797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.939911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] token.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.940032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.940166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.940264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.940359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.940454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] token.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.940550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.945794 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.945917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.946951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.947971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.connection = **** {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.connection = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.948979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949121 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.949984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950894 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:15:44.950976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:15:44.950976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:15:45.066034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.066257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.066349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.066478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.066566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.066701 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.075219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.075349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.103608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.103840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.104399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.104632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.165959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.166233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.214721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.214952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.215300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.215538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.281812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.282035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.282129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.282257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.282344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.282475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.282573 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.282691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.282777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.282906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.282991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.283175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.318540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.318766 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.318994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.319206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.319417 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.319625 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.319708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.319833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.319924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.320099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.320326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.320543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.320759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.320973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.331311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.331460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.343972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.344223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.344317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.344449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.344551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.344669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.344752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.344882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.344965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.345092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.345185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.345302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.345385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.345514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80456) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 17:15:45.362921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.363127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 17:15:45.363445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.363530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.363637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 17:15:45.363719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 17:15:45.363899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.363984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.364183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.364268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 17:15:45.364441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.364524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.364693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.364776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.364945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.365201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.375962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.376256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.376524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.376607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.376801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.376884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.377125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.377404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.384969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.385621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.388245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.388523 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.388801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.388913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.389073 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.389189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.389346 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.389468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.389596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.389748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.389855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.390028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.390109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.390318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.390458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.390582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.390731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.390851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.391002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.391104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.391369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.391633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.418180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.418828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.419720 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.419995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.420458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.420738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.425309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.425694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.425980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.426142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.426534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.426814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.433270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.433547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.434075 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.434353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.438532 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.438810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.439091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.439368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.439580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.439663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.439866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.439957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.440164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.440248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.440432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.440524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.446827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.446827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.446827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.446827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.459847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.460145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.460704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.460977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.464729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.465543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.468498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.468982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.469250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.469651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.473950 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.474663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.477537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.478418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.481221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.481512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.481792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.482069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.482152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.482341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.482424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.482611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.482694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.482895 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.483175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.483452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.502372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.502641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.502904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.503021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.503173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.503304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.503577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.503838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.511045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.511715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.512762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.513051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.513472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.513754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.518285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.518569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.518680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.518836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.518923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.519118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.519204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.519400 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.519496 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.519683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.533672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.533785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.533948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.534033 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.534227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.534312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.534501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.534584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.534872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.534961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.535148 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.535234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.535424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.535517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.553983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.554116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.557271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.557372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.560598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.560704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.562450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.562566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.563992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.564292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.564409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.564577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.564662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.564852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.571841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.572122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.573487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.573736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.576698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.576984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.577075 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.577271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.577414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.577694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.577854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.578151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.587243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.587535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.587813 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.588795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.589076 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.589348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.596239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80456) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.596515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.596792 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.597063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.597341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.597729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.597910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 17:15:45.598002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.598185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.598268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.598457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.598537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.598730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.598820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.598995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.599075 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.599298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.599376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.599564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.599645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.599825 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80456) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.599905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.600197 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.600470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.600738 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.601069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.601336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.601609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 17:15:45.638086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b52e5a9c0 pid: 80456 (default app) Jun 16 17:15:45.639704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b52e5a9c0 pid: 80457 (default app) Jun 16 17:15:45.641537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3cd8c-2f4e-4a40-b516-df4f020533e9 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:15:45.641826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3cd8c-2f4e-4a40-b516-df4f020533e9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:15:45.642107 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3cd8c-2f4e-4a40-b516-df4f020533e9 None None] PATH_INFO: `/v3` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:15:45.646586 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Thu Jun 16 17:15:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:15:54.696588 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557f29-1162-471a-a142-c20c6d0754f7 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:15:54.697102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557f29-1162-471a-a142-c20c6d0754f7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:15:54.697187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557f29-1162-471a-a142-c20c6d0754f7 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:15:54.701397 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:15:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:15:54.706842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:15:54.707245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:15:54.707427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:15:54.776177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: INFO dbcounter [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] Registered counter for database keystone Jun 16 17:15:54.798380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG oslo_db.sqlalchemy.engines [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:15:54.821918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writer thread running {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:15:54.981772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG passlib.handlers.bcrypt [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80456) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 17:15:54.982194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG passlib.handlers.bcrypt [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80456) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 17:15:55.036870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:15:55.038453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:15:55.163098 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:15:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 17:15:55.390577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b557f29-1162-471a-a142-c20c6d0754f7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:15:55.461075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: INFO dbcounter [None req-9b557f29-1162-471a-a142-c20c6d0754f7 None None] Registered counter for database keystone Jun 16 17:15:55.480568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG oslo_db.sqlalchemy.engines [None req-9b557f29-1162-471a-a142-c20c6d0754f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:15:55.487521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writer thread running {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:15:55.611139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b557f29-1162-471a-a142-c20c6d0754f7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:15:55.615422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3ca26-c449-4f57-95f9-a8acf5bb97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:15:55.616101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3ca26-c449-4f57-95f9-a8acf5bb97d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:15:55.616398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3ca26-c449-4f57-95f9-a8acf5bb97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:15:55.616680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3ca26-c449-4f57-95f9-a8acf5bb97d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:15:55.624967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3ca26-c449-4f57-95f9-a8acf5bb97d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:15:55.676968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: WARNING keystone.common.rbac_enforcer.enforcer [None req-25c3ca26-c449-4f57-95f9-a8acf5bb97d6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 17:15:55.677250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3ca26-c449-4f57-95f9-a8acf5bb97d6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:15:55.687018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Jun 16 17:15:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 17:15:55.693151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:15:55.710349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447e54f-9258-49f3-b229-d578414e3035 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:15:55.714745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49542b0e-f3d2-431c-a263-606d2d7c7c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:15:55.715875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49542b0e-f3d2-431c-a263-606d2d7c7c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:15:55.716197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49542b0e-f3d2-431c-a263-606d2d7c7c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:15:55.716477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49542b0e-f3d2-431c-a263-606d2d7c7c29 admin admin] PATH_INFO: `/v3/projects/6c79ada12a254f71981d5de110c2a5b7` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:15:55.718599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49542b0e-f3d2-431c-a263-606d2d7c7c29 admin admin] RBAC: Authorizing `identity:get_project(project_id=6c79ada12a254f71981d5de110c2a5b7)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:15:55.768736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: WARNING keystone.common.rbac_enforcer.enforcer [None req-49542b0e-f3d2-431c-a263-606d2d7c7c29 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 17:15:55.769084 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49542b0e-f3d2-431c-a263-606d2d7c7c29 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:15:55.773676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Thu Jun 16 17:15:55 2022] GET /identity/v3/projects/6c79ada12a254f71981d5de110c2a5b7 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:15:57.877470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e352-8738-4e75-86bd-955df767d5cc None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:15:57.877955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e352-8738-4e75-86bd-955df767d5cc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:15:57.877955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e352-8738-4e75-86bd-955df767d5cc None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:15:57.882113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:15:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:15:57.887561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab48c-b2c2-4eff-a932-176e01b23efc None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:15:57.887953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab48c-b2c2-4eff-a932-176e01b23efc None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:15:57.888170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab48c-b2c2-4eff-a932-176e01b23efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:15:57.908381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-329ab48c-b2c2-4eff-a932-176e01b23efc None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:15:57.909966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-329ab48c-b2c2-4eff-a932-176e01b23efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:15:57.917934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:15:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 16 17:15:57.940633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e352-8738-4e75-86bd-955df767d5cc None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:15:57.953276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e352-8738-4e75-86bd-955df767d5cc None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:15:57.957441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42e534-852a-4673-8b68-9f255e1b603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:15:57.958074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42e534-852a-4673-8b68-9f255e1b603e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:15:57.958358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42e534-852a-4673-8b68-9f255e1b603e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:15:57.958636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42e534-852a-4673-8b68-9f255e1b603e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:15:57.966168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42e534-852a-4673-8b68-9f255e1b603e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:15:57.968720 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42e534-852a-4673-8b68-9f255e1b603e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:15:57.977529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Thu Jun 16 17:15:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:15:57.982598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ab48c-b2c2-4eff-a932-176e01b23efc None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:15:57.991605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ab48c-b2c2-4eff-a932-176e01b23efc None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:15:57.996084 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b46bf-f3a9-4745-a1a5-04ae8ce4fa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:15:57.996965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b46bf-f3a9-4745-a1a5-04ae8ce4fa1b admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:15:57.997256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b46bf-f3a9-4745-a1a5-04ae8ce4fa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:15:57.997538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b46bf-f3a9-4745-a1a5-04ae8ce4fa1b admin admin] PATH_INFO: `/v3/users/a30ed168831044238fab0d0dd5d1bd65` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:15:57.998934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b46bf-f3a9-4745-a1a5-04ae8ce4fa1b admin admin] RBAC: Authorizing `identity:get_user(user_id=a30ed168831044238fab0d0dd5d1bd65)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:15:58.000908 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b46bf-f3a9-4745-a1a5-04ae8ce4fa1b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:15:58.002483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Thu Jun 16 17:15:57 2022] GET /identity/v3/users/a30ed168831044238fab0d0dd5d1bd65 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:00.213539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ac86-0366-4776-ae0a-ae24ec399bf0 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:00.214110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ac86-0366-4776-ae0a-ae24ec399bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:00.214110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ac86-0366-4776-ae0a-ae24ec399bf0 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:00.215439 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:00.218111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60280cae-dccc-4ad3-8508-de7d0c39859d None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:00.218533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60280cae-dccc-4ad3-8508-de7d0c39859d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:00.218742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60280cae-dccc-4ad3-8508-de7d0c39859d None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:00.220643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:00.221757 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0259467-7199-4abd-b8d3-9eee10b1294a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:00.222056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0259467-7199-4abd-b8d3-9eee10b1294a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:00.222341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0259467-7199-4abd-b8d3-9eee10b1294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:00.225391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f01309-b07a-4ad2-b96a-8ce7474ffffe None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:00.225680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f01309-b07a-4ad2-b96a-8ce7474ffffe None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:00.225956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f01309-b07a-4ad2-b96a-8ce7474ffffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:00.242069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d7f01309-b07a-4ad2-b96a-8ce7474ffffe None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:00.243259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d7f01309-b07a-4ad2-b96a-8ce7474ffffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:00.264233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG passlib.handlers.bcrypt [None req-a0259467-7199-4abd-b8d3-9eee10b1294a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80457) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 17:16:00.265702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG passlib.handlers.bcrypt [None req-a0259467-7199-4abd-b8d3-9eee10b1294a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80457) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 17:16:00.318866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a0259467-7199-4abd-b8d3-9eee10b1294a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:00.320637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a0259467-7199-4abd-b8d3-9eee10b1294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:00.325219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 7/12] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:00.348860 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f01309-b07a-4ad2-b96a-8ce7474ffffe None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:00.372139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:00.436113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 6/13] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:00.459694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f01309-b07a-4ad2-b96a-8ce7474ffffe None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:00.460466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0259467-7199-4abd-b8d3-9eee10b1294a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:00.493633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d16f6-7ec3-4b77-aea3-b35634eb5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:00.494221 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d16f6-7ec3-4b77-aea3-b35634eb5462 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:00.494507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d16f6-7ec3-4b77-aea3-b35634eb5462 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:00.494786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d16f6-7ec3-4b77-aea3-b35634eb5462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:00.563539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d16f6-7ec3-4b77-aea3-b35634eb5462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:00.565056 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d16f6-7ec3-4b77-aea3-b35634eb5462 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:00.566251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0259467-7199-4abd-b8d3-9eee10b1294a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:00.569220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:00.592640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:00.606459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6343b9-b859-4d93-b36f-489c12e0df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:00.607505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6343b9-b859-4d93-b36f-489c12e0df66 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:00.607797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6343b9-b859-4d93-b36f-489c12e0df66 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:00.608079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6343b9-b859-4d93-b36f-489c12e0df66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:00.619962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6343b9-b859-4d93-b36f-489c12e0df66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-4d6343b9-b859-4d93-b36f-489c12e0df66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:00.632228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:00.633195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:00.634002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:00.639229 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6343b9-b859-4d93-b36f-489c12e0df66 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:00.670425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 8/15] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:16:00.676273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d16f6-7ec3-4b77-aea3-b35634eb5462 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:00.741242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6343b9-b859-4d93-b36f-489c12e0df66 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:00.775076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d16f6-7ec3-4b77-aea3-b35634eb5462 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:00.777473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff78c39-28b4-4e46-8253-d59c22ff8a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:00.778170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff78c39-28b4-4e46-8253-d59c22ff8a3a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:00.778457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff78c39-28b4-4e46-8253-d59c22ff8a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:00.778733 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff78c39-28b4-4e46-8253-d59c22ff8a3a None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:00.779482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff78c39-28b4-4e46-8253-d59c22ff8a3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:00.779791 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff78c39-28b4-4e46-8253-d59c22ff8a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:00.781514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff78c39-28b4-4e46-8253-d59c22ff8a3a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:00.793414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 8/16] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:00.799410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:00.799627 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff78c39-28b4-4e46-8253-d59c22ff8a3a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:00.809727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6146b-e272-4a5a-bbd3-b8e55d883257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:00.810522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6146b-e272-4a5a-bbd3-b8e55d883257 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:00.810805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6146b-e272-4a5a-bbd3-b8e55d883257 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:00.814928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6146b-e272-4a5a-bbd3-b8e55d883257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:00.822422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6146b-e272-4a5a-bbd3-b8e55d883257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:00.823981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6146b-e272-4a5a-bbd3-b8e55d883257 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:00.826833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-38d6146b-e272-4a5a-bbd3-b8e55d883257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:16:00.845608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:00.846621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:00.847610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:16:00.847610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:16:00.847610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:16:00.847610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:00.847610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 9/17] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:00.852665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6146b-e272-4a5a-bbd3-b8e55d883257 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:00.905483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff78c39-28b4-4e46-8253-d59c22ff8a3a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:00.939891 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fff7cb-db9d-4063-a407-0a7739ee77a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:00.940923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fff7cb-db9d-4063-a407-0a7739ee77a6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:00.941215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fff7cb-db9d-4063-a407-0a7739ee77a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:00.941496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fff7cb-db9d-4063-a407-0a7739ee77a6 None admin] PATH_INFO: `/v3/users/a30ed168831044238fab0d0dd5d1bd65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:00.943064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fff7cb-db9d-4063-a407-0a7739ee77a6 None admin] RBAC: Authorizing `identity:get_user(user_id=a30ed168831044238fab0d0dd5d1bd65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:00.944590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fff7cb-db9d-4063-a407-0a7739ee77a6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:00.946206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 9/18] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:00 2022] GET /identity/v3/users/a30ed168831044238fab0d0dd5d1bd65 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:00.951526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fff7cb-db9d-4063-a407-0a7739ee77a6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:00.954315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6146b-e272-4a5a-bbd3-b8e55d883257 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:00.987954 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df03d-53fb-4a96-8cc2-c6de433fc48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:00.988654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df03d-53fb-4a96-8cc2-c6de433fc48d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:00.988940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df03d-53fb-4a96-8cc2-c6de433fc48d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:00.989224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371df03d-53fb-4a96-8cc2-c6de433fc48d None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:00.989945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371df03d-53fb-4a96-8cc2-c6de433fc48d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:00.990257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371df03d-53fb-4a96-8cc2-c6de433fc48d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:00.991659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371df03d-53fb-4a96-8cc2-c6de433fc48d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:01.009429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 10/19] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:01.051600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:01.058442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fff7cb-db9d-4063-a407-0a7739ee77a6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:01.095296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd263f-8d90-4a1e-a854-9a8ee1b5af6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:01.096161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd263f-8d90-4a1e-a854-9a8ee1b5af6a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:01.096453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd263f-8d90-4a1e-a854-9a8ee1b5af6a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:01.096731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd263f-8d90-4a1e-a854-9a8ee1b5af6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:01.097983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd263f-8d90-4a1e-a854-9a8ee1b5af6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:01.099460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd263f-8d90-4a1e-a854-9a8ee1b5af6a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:01.101144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 10/20] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:01.107059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df03d-53fb-4a96-8cc2-c6de433fc48d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:01.144321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:01.215644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371df03d-53fb-4a96-8cc2-c6de433fc48d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:01.252680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b4c92-0a21-46db-959e-d8ff09a20e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:01.253401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b4c92-0a21-46db-959e-d8ff09a20e13 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:01.253631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b4c92-0a21-46db-959e-d8ff09a20e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:01.253915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b4c92-0a21-46db-959e-d8ff09a20e13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:01.254744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b4c92-0a21-46db-959e-d8ff09a20e13 None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.domain.id=default, user.id=a30ed168831044238fab0d0dd5d1bd65) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:01.255064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b4c92-0a21-46db-959e-d8ff09a20e13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:01.256557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b4c92-0a21-46db-959e-d8ff09a20e13 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:01.263656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 11/21] 10.222.0.77 () {56 vars in 1322 bytes} [Thu Jun 16 17:16:01 2022] GET /identity/v3/role_assignments?user.id=a30ed168831044238fab0d0dd5d1bd65&scope.domain.id=default&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:03.698776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47add5a3-2522-443f-b2a8-5400239fa891 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:03.699789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47add5a3-2522-443f-b2a8-5400239fa891 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:03.700305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47add5a3-2522-443f-b2a8-5400239fa891 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:03.702567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 11/22] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:03.707814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef72d-7573-44f6-8df6-f6b3fc709769 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:03.708743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef72d-7573-44f6-8df6-f6b3fc709769 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:03.709219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef72d-7573-44f6-8df6-f6b3fc709769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:03.733268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6d5ef72d-7573-44f6-8df6-f6b3fc709769 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:03.735010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6d5ef72d-7573-44f6-8df6-f6b3fc709769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:03.834693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 12/23] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:03.877848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47add5a3-2522-443f-b2a8-5400239fa891 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:04.030895 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47add5a3-2522-443f-b2a8-5400239fa891 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:04.053905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158df52-7c1a-43ce-8ef3-8f340c6686ac None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:04.054566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158df52-7c1a-43ce-8ef3-8f340c6686ac None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:04.055053 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158df52-7c1a-43ce-8ef3-8f340c6686ac None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:04.056781 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 13/24] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:04.064213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e2265-3e88-41ee-b83d-5d96c0a0a5fc None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:04.064785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e2265-3e88-41ee-b83d-5d96c0a0a5fc None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:04.065288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e2265-3e88-41ee-b83d-5d96c0a0a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:04.082087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f6bc6-5d8b-4b37-85f6-ffb2e4c15d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:04.082774 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f6bc6-5d8b-4b37-85f6-ffb2e4c15d3f None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:04.083059 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f6bc6-5d8b-4b37-85f6-ffb2e4c15d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:04.083339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f6bc6-5d8b-4b37-85f6-ffb2e4c15d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:04.084110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f6bc6-5d8b-4b37-85f6-ffb2e4c15d3f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:04.085570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f6bc6-5d8b-4b37-85f6-ffb2e4c15d3f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:04.101096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a27e2265-3e88-41ee-b83d-5d96c0a0a5fc None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:04.102618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a27e2265-3e88-41ee-b83d-5d96c0a0a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:04.138390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:04.198502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 14/25] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:04.237987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e2265-3e88-41ee-b83d-5d96c0a0a5fc None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:04.353809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 12/26] 10.222.0.77 () {60 vars in 1131 bytes} [Thu Jun 16 17:16:03 2022] POST /identity/v3/roles => generated 219 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:04.355732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efc6ce-e6ac-43c6-bdd8-4892ec7db49e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:04.356212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efc6ce-e6ac-43c6-bdd8-4892ec7db49e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:04.356638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efc6ce-e6ac-43c6-bdd8-4892ec7db49e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:04.358269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 13/27] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:04.364217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276f433-381d-4a32-8b10-f31e97c97b4d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:04.364779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276f433-381d-4a32-8b10-f31e97c97b4d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:04.365200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276f433-381d-4a32-8b10-f31e97c97b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:04.397596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5276f433-381d-4a32-8b10-f31e97c97b4d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:04.399192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5276f433-381d-4a32-8b10-f31e97c97b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:04.431477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:04.447862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e2265-3e88-41ee-b83d-5d96c0a0a5fc None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:04.536890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4c994-8a79-4e79-85b4-693bada2fd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:04.538183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c994-8a79-4e79-85b4-693bada2fd68 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:04.538689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c994-8a79-4e79-85b4-693bada2fd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:04.539173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c994-8a79-4e79-85b4-693bada2fd68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:04.539709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 14/28] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:04.541354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d443c-f80c-49f9-a287-d1d58932789c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:04.541651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d443c-f80c-49f9-a287-d1d58932789c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:04.541937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d443c-f80c-49f9-a287-d1d58932789c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:04.543197 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 15/29] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:04.549530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a7d74-c47e-479e-9ddc-f65472630171 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:04.550016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a7d74-c47e-479e-9ddc-f65472630171 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:04.550481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a7d74-c47e-479e-9ddc-f65472630171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:04.553991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4c994-8a79-4e79-85b4-693bada2fd68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:04.555923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4c994-8a79-4e79-85b4-693bada2fd68 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-37d4c994-8a79-4e79-85b4-693bada2fd68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:16:04.588485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:04.589348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:04.590117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:16:04.590117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:16:04.590117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:16:04.590117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:04.590117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 15/30] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:04.591045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4c994-8a79-4e79-85b4-693bada2fd68 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:04.591995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-886a7d74-c47e-479e-9ddc-f65472630171 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:04.593780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-886a7d74-c47e-479e-9ddc-f65472630171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:04.603690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:04.678032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 16/31] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:04.679251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a7d74-c47e-479e-9ddc-f65472630171 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:04.700588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4c994-8a79-4e79-85b4-693bada2fd68 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:04.738726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82866dc-92f3-4b9f-9e10-89a0b1dd4c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:04.739408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82866dc-92f3-4b9f-9e10-89a0b1dd4c79 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:04.739867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82866dc-92f3-4b9f-9e10-89a0b1dd4c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:04.740327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82866dc-92f3-4b9f-9e10-89a0b1dd4c79 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:04.741346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82866dc-92f3-4b9f-9e10-89a0b1dd4c79 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:04.742863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82866dc-92f3-4b9f-9e10-89a0b1dd4c79 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:04.786167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:04.809046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a7d74-c47e-479e-9ddc-f65472630171 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:04.846542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d4122-13f6-43d1-bbc2-fcb9dd7e6a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:04.847261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d4122-13f6-43d1-bbc2-fcb9dd7e6a19 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:04.847537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d4122-13f6-43d1-bbc2-fcb9dd7e6a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:04.847825 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d4122-13f6-43d1-bbc2-fcb9dd7e6a19 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:04.848612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d4122-13f6-43d1-bbc2-fcb9dd7e6a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:04.848927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d4122-13f6-43d1-bbc2-fcb9dd7e6a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:04.850649 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d4122-13f6-43d1-bbc2-fcb9dd7e6a19 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:04.875190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 17/32] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:04.876054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d4122-13f6-43d1-bbc2-fcb9dd7e6a19 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:04.996970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d4122-13f6-43d1-bbc2-fcb9dd7e6a19 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:05.035976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a62cc-0693-4e21-9d8b-c03f85157dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:05.036821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a62cc-0693-4e21-9d8b-c03f85157dfc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.037108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a62cc-0693-4e21-9d8b-c03f85157dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.037384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a62cc-0693-4e21-9d8b-c03f85157dfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.048526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a62cc-0693-4e21-9d8b-c03f85157dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-f49a62cc-0693-4e21-9d8b-c03f85157dfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:05.056264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:05.057251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:05.058070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 18/33] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:05.058751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a62cc-0693-4e21-9d8b-c03f85157dfc None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:05.066229 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:05.085143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 16/34] 10.222.0.77 () {60 vars in 1131 bytes} [Thu Jun 16 17:16:04 2022] POST /identity/v3/roles => generated 225 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:05.086801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d66e-3e95-46c1-9b26-22427324d6aa None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.087098 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d66e-3e95-46c1-9b26-22427324d6aa None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.087377 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d66e-3e95-46c1-9b26-22427324d6aa None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.088797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 17/35] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:05.089943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be99a-0012-4b30-a7ae-a0cb2c07bdeb None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.090236 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be99a-0012-4b30-a7ae-a0cb2c07bdeb None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.090523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be99a-0012-4b30-a7ae-a0cb2c07bdeb None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.092242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 18/36] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:05.093481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717be99a-0012-4b30-a7ae-a0cb2c07bdeb None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:05.180005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a62cc-0693-4e21-9d8b-c03f85157dfc None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:05.184785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:05.221256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0d636-8e38-4763-a387-5d4f534c2951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:05.221945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0d636-8e38-4763-a387-5d4f534c2951 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.233574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0d636-8e38-4763-a387-5d4f534c2951 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.233574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0d636-8e38-4763-a387-5d4f534c2951 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.233897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717be99a-0012-4b30-a7ae-a0cb2c07bdeb None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:05.234002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0d636-8e38-4763-a387-5d4f534c2951 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:05.234002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0d636-8e38-4763-a387-5d4f534c2951 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:05.260961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a4935-48d4-412f-a25f-dfac71ae3f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:05.261565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4935-48d4-412f-a25f-dfac71ae3f53 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.261856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4935-48d4-412f-a25f-dfac71ae3f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.262134 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4935-48d4-412f-a25f-dfac71ae3f53 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.262886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a4935-48d4-412f-a25f-dfac71ae3f53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:05.263238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a4935-48d4-412f-a25f-dfac71ae3f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:05.266191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a4935-48d4-412f-a25f-dfac71ae3f53 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:05.278582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 19/37] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:05.280628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c3d1-df10-400f-a5f9-9997141ee945 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.281068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c3d1-df10-400f-a5f9-9997141ee945 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.281379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c3d1-df10-400f-a5f9-9997141ee945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.298454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-eb40c3d1-df10-400f-a5f9-9997141ee945 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:05.299975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-eb40c3d1-df10-400f-a5f9-9997141ee945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:05.357615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 19/38] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:16:05 2022] POST /identity/v3/projects => generated 301 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:05.359802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13628b3-1ca5-4833-95a8-296327c5e334 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.360149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13628b3-1ca5-4833-95a8-296327c5e334 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.360446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13628b3-1ca5-4833-95a8-296327c5e334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.367507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 20/39] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:05.368566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c3d1-df10-400f-a5f9-9997141ee945 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:05.380568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b13628b3-1ca5-4833-95a8-296327c5e334 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:05.381714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b13628b3-1ca5-4833-95a8-296327c5e334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:05.446262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:05.496624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c3d1-df10-400f-a5f9-9997141ee945 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:05.540299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730d852-ce45-44bf-88c0-a8ee7d03c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:05.541119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d852-ce45-44bf-88c0-a8ee7d03c980 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.541408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d852-ce45-44bf-88c0-a8ee7d03c980 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.541684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d852-ce45-44bf-88c0-a8ee7d03c980 None admin] PATH_INFO: `/v3/users/a30ed168831044238fab0d0dd5d1bd65` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.542942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730d852-ce45-44bf-88c0-a8ee7d03c980 None admin] RBAC: Authorizing `identity:get_user(user_id=a30ed168831044238fab0d0dd5d1bd65)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:05.544465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730d852-ce45-44bf-88c0-a8ee7d03c980 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:05.553606 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 21/40] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:05 2022] GET /identity/v3/users/a30ed168831044238fab0d0dd5d1bd65 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:05.553606 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730d852-ce45-44bf-88c0-a8ee7d03c980 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:05.558668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:05.580891 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 20/41] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:05.585299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13628b3-1ca5-4833-95a8-296327c5e334 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:05.670374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730d852-ce45-44bf-88c0-a8ee7d03c980 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:05.700306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:05.707238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416eae0-9669-446b-9186-f87489f16022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:05.707977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416eae0-9669-446b-9186-f87489f16022 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.708302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416eae0-9669-446b-9186-f87489f16022 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.708583 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416eae0-9669-446b-9186-f87489f16022 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.709389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416eae0-9669-446b-9186-f87489f16022 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:05.710060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13628b3-1ca5-4833-95a8-296327c5e334 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:05.710837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416eae0-9669-446b-9186-f87489f16022 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:05.743211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9030c5-cb1c-4ff9-905c-072d11a97ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:05.744040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9030c5-cb1c-4ff9-905c-072d11a97ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.744372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9030c5-cb1c-4ff9-905c-072d11a97ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.744787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9030c5-cb1c-4ff9-905c-072d11a97ef2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.745961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9030c5-cb1c-4ff9-905c-072d11a97ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:05.747411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9030c5-cb1c-4ff9-905c-072d11a97ef2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:05.749743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 21/42] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:05.750492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9030c5-cb1c-4ff9-905c-072d11a97ef2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:05.802084 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:05.847523 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9030c5-cb1c-4ff9-905c-072d11a97ef2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:05.879834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f9ecc-c172-4f1f-9eab-a1ed2f421720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:05.880650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9ecc-c172-4f1f-9eab-a1ed2f421720 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:05.880941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9ecc-c172-4f1f-9eab-a1ed2f421720 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:05.881223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9ecc-c172-4f1f-9eab-a1ed2f421720 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:05.882388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f9ecc-c172-4f1f-9eab-a1ed2f421720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:05.883816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f9ecc-c172-4f1f-9eab-a1ed2f421720 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:05.885431 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 22/43] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:05.886158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f9ecc-c172-4f1f-9eab-a1ed2f421720 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:05.909762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 22/44] 10.222.0.77 () {60 vars in 1131 bytes} [Thu Jun 16 17:16:05 2022] POST /identity/v3/roles => generated 223 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:05.910450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416eae0-9669-446b-9186-f87489f16022 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:06.006571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f9ecc-c172-4f1f-9eab-a1ed2f421720 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:06.034627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416eae0-9669-446b-9186-f87489f16022 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:06.035784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:06.054192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b389969-2d4a-4728-94d0-43659b8ef011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:06.055171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389969-2d4a-4728-94d0-43659b8ef011 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:06.055466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389969-2d4a-4728-94d0-43659b8ef011 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:06.055757 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b389969-2d4a-4728-94d0-43659b8ef011 None admin] PATH_INFO: `/v3/domains/default/users/a30ed168831044238fab0d0dd5d1bd65/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:06.058062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b389969-2d4a-4728-94d0-43659b8ef011 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a30ed168831044238fab0d0dd5d1bd65, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:06.059651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b389969-2d4a-4728-94d0-43659b8ef011 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:06.073594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f6a23-4b29-4378-8666-82a20ee7e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:06.074292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f6a23-4b29-4378-8666-82a20ee7e88d None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:06.074620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f6a23-4b29-4378-8666-82a20ee7e88d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:06.074898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f6a23-4b29-4378-8666-82a20ee7e88d None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:06.079349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f6a23-4b29-4378-8666-82a20ee7e88d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:06.079349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f6a23-4b29-4378-8666-82a20ee7e88d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:06.206880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 23/45] 10.222.0.77 () {58 vars in 1361 bytes} [Thu Jun 16 17:16:05 2022] PUT /identity/v3/domains/default/users/a30ed168831044238fab0d0dd5d1bd65/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:16:06.249424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 23/46] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:16:05 2022] POST /identity/v3/projects => generated 312 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:08.325894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c41fa0-a2e7-48c9-9428-ffa75a14decf None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:08.326455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c41fa0-a2e7-48c9-9428-ffa75a14decf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:08.326455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c41fa0-a2e7-48c9-9428-ffa75a14decf None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:08.328019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 24/47] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:08.333383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771143-7f15-49f9-a770-b509d225ae3d None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:08.333821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771143-7f15-49f9-a770-b509d225ae3d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:08.333964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771143-7f15-49f9-a770-b509d225ae3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:08.350931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-93771143-7f15-49f9-a770-b509d225ae3d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:08.352153 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-93771143-7f15-49f9-a770-b509d225ae3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:08.387298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:08.418608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 24/48] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:08.442391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c41fa0-a2e7-48c9-9428-ffa75a14decf None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:08.525194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbc647-c231-489e-9771-a565f05cd98b None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:08.525484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbc647-c231-489e-9771-a565f05cd98b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:08.525767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbc647-c231-489e-9771-a565f05cd98b None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:08.527138 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 25/49] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:08.532855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835f964-4c1a-41cd-8bd5-9f5cc92660f9 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:08.533144 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835f964-4c1a-41cd-8bd5-9f5cc92660f9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:08.533421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835f964-4c1a-41cd-8bd5-9f5cc92660f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:08.550382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4835f964-4c1a-41cd-8bd5-9f5cc92660f9 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:08.551581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4835f964-4c1a-41cd-8bd5-9f5cc92660f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:08.553035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c41fa0-a2e7-48c9-9428-ffa75a14decf None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:08.589693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da981a8-d7aa-4d95-a1ef-e24c3832588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:08.590501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da981a8-d7aa-4d95-a1ef-e24c3832588d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:08.590790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da981a8-d7aa-4d95-a1ef-e24c3832588d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:08.591073 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da981a8-d7aa-4d95-a1ef-e24c3832588d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:08.601573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da981a8-d7aa-4d95-a1ef-e24c3832588d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-3da981a8-d7aa-4d95-a1ef-e24c3832588d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:08.610122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:08.610963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:08.611706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 25/50] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:16:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:08.617034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da981a8-d7aa-4d95-a1ef-e24c3832588d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:08.621051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 26/51] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:08.645851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835f964-4c1a-41cd-8bd5-9f5cc92660f9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:08.669039 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:08.728126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da981a8-d7aa-4d95-a1ef-e24c3832588d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:08.745427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835f964-4c1a-41cd-8bd5-9f5cc92660f9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:08.747081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:08.762593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc109-81c1-4db9-8641-837217ea6b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:08.763347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc109-81c1-4db9-8641-837217ea6b51 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:08.763639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc109-81c1-4db9-8641-837217ea6b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:08.763917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc109-81c1-4db9-8641-837217ea6b51 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:08.764760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabc109-81c1-4db9-8641-837217ea6b51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:08.765069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabc109-81c1-4db9-8641-837217ea6b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:08.766467 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabc109-81c1-4db9-8641-837217ea6b51 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:08.774814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 26/52] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:08.781309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc109-81c1-4db9-8641-837217ea6b51 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:08.782166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d211-d42e-4ab8-ba9d-b4845c38e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:08.782984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d211-d42e-4ab8-ba9d-b4845c38e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:08.783274 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d211-d42e-4ab8-ba9d-b4845c38e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:08.783555 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d211-d42e-4ab8-ba9d-b4845c38e6c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:08.784771 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3d211-d42e-4ab8-ba9d-b4845c38e6c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:08.786241 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3d211-d42e-4ab8-ba9d-b4845c38e6c5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:08.787870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 27/53] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:08.793354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d211-d42e-4ab8-ba9d-b4845c38e6c5 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:08.886029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc109-81c1-4db9-8641-837217ea6b51 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:08.887602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:08.893264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d211-d42e-4ab8-ba9d-b4845c38e6c5 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:08.922131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db433a-a537-4e8e-a50a-15326284d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:08.923044 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db433a-a537-4e8e-a50a-15326284d632 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:08.923307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db433a-a537-4e8e-a50a-15326284d632 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:08.923581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db433a-a537-4e8e-a50a-15326284d632 None admin] PATH_INFO: `/v3/users/a30ed168831044238fab0d0dd5d1bd65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:08.924812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db433a-a537-4e8e-a50a-15326284d632 None admin] RBAC: Authorizing `identity:get_user(user_id=a30ed168831044238fab0d0dd5d1bd65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:08.926385 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db433a-a537-4e8e-a50a-15326284d632 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:08.928476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 27/54] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:08 2022] GET /identity/v3/users/a30ed168831044238fab0d0dd5d1bd65 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:08.932883 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40310bb0-3748-4fc7-b324-d3b56d305a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:08.933548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40310bb0-3748-4fc7-b324-d3b56d305a22 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:08.933833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40310bb0-3748-4fc7-b324-d3b56d305a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:08.933927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db433a-a537-4e8e-a50a-15326284d632 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:08.934107 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40310bb0-3748-4fc7-b324-d3b56d305a22 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:08.934820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40310bb0-3748-4fc7-b324-d3b56d305a22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:08.936303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40310bb0-3748-4fc7-b324-d3b56d305a22 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:09.033900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db433a-a537-4e8e-a50a-15326284d632 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:09.066887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d46bc-aa73-4465-8bb1-47e3283ab380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:09.067679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d46bc-aa73-4465-8bb1-47e3283ab380 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:09.067963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d46bc-aa73-4465-8bb1-47e3283ab380 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:09.068268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d46bc-aa73-4465-8bb1-47e3283ab380 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:09.069451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d46bc-aa73-4465-8bb1-47e3283ab380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:09.070893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d46bc-aa73-4465-8bb1-47e3283ab380 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:09.072628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 28/55] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:09.078032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 28/56] 10.222.0.77 () {60 vars in 1140 bytes} [Thu Jun 16 17:16:08 2022] POST /identity/v3/projects => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:16:09.079036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d46bc-aa73-4465-8bb1-47e3283ab380 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:09.123428 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:09.202603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d46bc-aa73-4465-8bb1-47e3283ab380 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:09.235994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baece7-0239-4dce-9aac-dfd0f9966c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:09.236703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baece7-0239-4dce-9aac-dfd0f9966c07 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:09.236992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baece7-0239-4dce-9aac-dfd0f9966c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:09.237277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baece7-0239-4dce-9aac-dfd0f9966c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:09.238117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baece7-0239-4dce-9aac-dfd0f9966c07 None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.domain.id=default, user.id=a30ed168831044238fab0d0dd5d1bd65) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:09.238460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baece7-0239-4dce-9aac-dfd0f9966c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:09.239966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baece7-0239-4dce-9aac-dfd0f9966c07 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:09.248460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 29/57] 10.222.0.77 () {56 vars in 1322 bytes} [Thu Jun 16 17:16:09 2022] GET /identity/v3/role_assignments?user.id=a30ed168831044238fab0d0dd5d1bd65&scope.domain.id=default&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 530 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:11.212805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e71c6-ed2b-4ce2-92c6-2b33c982a3fa None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:11.213323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e71c6-ed2b-4ce2-92c6-2b33c982a3fa None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:11.213408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e71c6-ed2b-4ce2-92c6-2b33c982a3fa None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:11.214713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 29/58] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:11.219944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a50815-f3b8-4be1-97f2-39bf9b91a244 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:11.220389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a50815-f3b8-4be1-97f2-39bf9b91a244 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:11.220547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a50815-f3b8-4be1-97f2-39bf9b91a244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:11.237308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f5a50815-f3b8-4be1-97f2-39bf9b91a244 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:11.238499 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f5a50815-f3b8-4be1-97f2-39bf9b91a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:11.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 30/59] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:11.332670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e71c6-ed2b-4ce2-92c6-2b33c982a3fa None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:11.357102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:11.432787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e71c6-ed2b-4ce2-92c6-2b33c982a3fa None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:11.466245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f5c6d-deb3-4288-a304-da769b498d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:11.466985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f5c6d-deb3-4288-a304-da769b498d7d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:11.467298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f5c6d-deb3-4288-a304-da769b498d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:11.467582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f5c6d-deb3-4288-a304-da769b498d7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:11.468777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f5c6d-deb3-4288-a304-da769b498d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:11.470213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f5c6d-deb3-4288-a304-da769b498d7d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:11.471812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 30/60] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:11.477287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a50815-f3b8-4be1-97f2-39bf9b91a244 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:11.508920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:11.578581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a50815-f3b8-4be1-97f2-39bf9b91a244 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:11.611819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6480c-c1a1-4abf-804f-0e3bb09bb4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:11.612514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6480c-c1a1-4abf-804f-0e3bb09bb4d1 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:11.612799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6480c-c1a1-4abf-804f-0e3bb09bb4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:11.613072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6480c-c1a1-4abf-804f-0e3bb09bb4d1 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:11.613780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6480c-c1a1-4abf-804f-0e3bb09bb4d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:11.615228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6480c-c1a1-4abf-804f-0e3bb09bb4d1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:11.738817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 31/61] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:16:11 2022] POST /identity/v3/users => generated 275 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:15.145803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488a896-c2fa-4761-81b7-316dd82c88b5 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.147008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488a896-c2fa-4761-81b7-316dd82c88b5 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.147524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488a896-c2fa-4761-81b7-316dd82c88b5 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.149715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 31/62] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:15.157399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855038-f9de-4312-8d0a-4e3dd5faf764 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.158429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855038-f9de-4312-8d0a-4e3dd5faf764 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.158970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855038-f9de-4312-8d0a-4e3dd5faf764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.184344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ea855038-f9de-4312-8d0a-4e3dd5faf764 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:15.186812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ea855038-f9de-4312-8d0a-4e3dd5faf764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:15.209888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac79b1-d156-40fe-8207-eff3b39189d6 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.210598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac79b1-d156-40fe-8207-eff3b39189d6 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.211149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac79b1-d156-40fe-8207-eff3b39189d6 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.213027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 32/63] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:15.221284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cfdfc-6b3c-4279-b604-0e0f89a61286 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.221864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cfdfc-6b3c-4279-b604-0e0f89a61286 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.222359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cfdfc-6b3c-4279-b604-0e0f89a61286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.257130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-5b0cfdfc-6b3c-4279-b604-0e0f89a61286 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:15.258748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5b0cfdfc-6b3c-4279-b604-0e0f89a61286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:15.270130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 32/64] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:15.355828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea855038-f9de-4312-8d0a-4e3dd5faf764 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:15.381690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 33/65] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:15.397790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b833aba-d918-428c-8a86-2134141782e0 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.398297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b833aba-d918-428c-8a86-2134141782e0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.398720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b833aba-d918-428c-8a86-2134141782e0 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.400256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 34/66] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:15.404116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:15.406135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3b08a-af6d-4533-87f1-ca295c5c616d None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.406595 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3b08a-af6d-4533-87f1-ca295c5c616d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.407023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3b08a-af6d-4533-87f1-ca295c5c616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.426700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d7d3b08a-af6d-4533-87f1-ca295c5c616d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:15.427892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d7d3b08a-af6d-4533-87f1-ca295c5c616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:15.442486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:15.503105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 35/67] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:15.504420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3b08a-af6d-4533-87f1-ca295c5c616d None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:15.537936 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea855038-f9de-4312-8d0a-4e3dd5faf764 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:15.575350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fd739-57f7-44d5-87f8-30ec1d3abbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:15.586081 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd739-57f7-44d5-87f8-30ec1d3abbcd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.586081 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd739-57f7-44d5-87f8-30ec1d3abbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.586081 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd739-57f7-44d5-87f8-30ec1d3abbcd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.587633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fd739-57f7-44d5-87f8-30ec1d3abbcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-861fd739-57f7-44d5-87f8-30ec1d3abbcd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:15.595967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:15.596857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:15.597634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 33/68] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:15.598272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fd739-57f7-44d5-87f8-30ec1d3abbcd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:15.626760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3b08a-af6d-4533-87f1-ca295c5c616d None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:15.662237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f7393-8997-4cbe-9878-edd496e04154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:15.662962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f7393-8997-4cbe-9878-edd496e04154 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.663249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f7393-8997-4cbe-9878-edd496e04154 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.663533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f7393-8997-4cbe-9878-edd496e04154 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.675803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f7393-8997-4cbe-9878-edd496e04154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-3c2f7393-8997-4cbe-9878-edd496e04154 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:15.684758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:15.685588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 36/69] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:15.691208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03976def-95c6-4bbc-8082-644c27a6a088 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.691885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03976def-95c6-4bbc-8082-644c27a6a088 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.691885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03976def-95c6-4bbc-8082-644c27a6a088 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.691885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 37/70] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:15.691885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ee3d6-7b67-4e87-8e31-6bb197d16ed4 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.691885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ee3d6-7b67-4e87-8e31-6bb197d16ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.691885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ee3d6-7b67-4e87-8e31-6bb197d16ed4 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.692647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 38/71] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:15.692800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ee3d6-7b67-4e87-8e31-6bb197d16ed4 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:15.698067 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fd739-57f7-44d5-87f8-30ec1d3abbcd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:15.701129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:15.706817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:15.734424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a870d4-0ed4-455f-96cf-dbb371be21be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:15.735787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a870d4-0ed4-455f-96cf-dbb371be21be None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.736327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a870d4-0ed4-455f-96cf-dbb371be21be None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.736841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a870d4-0ed4-455f-96cf-dbb371be21be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.738622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a870d4-0ed4-455f-96cf-dbb371be21be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:15.740119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a870d4-0ed4-455f-96cf-dbb371be21be None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:15.741784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 34/72] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:15.742559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a870d4-0ed4-455f-96cf-dbb371be21be None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:15.797268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ee3d6-7b67-4e87-8e31-6bb197d16ed4 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:15.831516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e33f5-20fa-4ae0-b1ff-26c1cee7e636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:15.832212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e33f5-20fa-4ae0-b1ff-26c1cee7e636 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.832501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e33f5-20fa-4ae0-b1ff-26c1cee7e636 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.832781 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e33f5-20fa-4ae0-b1ff-26c1cee7e636 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.833526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e33f5-20fa-4ae0-b1ff-26c1cee7e636 None admin] RBAC: Adding query filter params (name=member) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:15.833834 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e33f5-20fa-4ae0-b1ff-26c1cee7e636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:15.835233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e33f5-20fa-4ae0-b1ff-26c1cee7e636 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:15.843760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 39/73] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:15.844960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ccac-cabc-4fff-a54c-fc9b7236a0c2 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.845250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ccac-cabc-4fff-a54c-fc9b7236a0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.845533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ccac-cabc-4fff-a54c-fc9b7236a0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.850597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a870d4-0ed4-455f-96cf-dbb371be21be None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:15.861889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-07f9ccac-cabc-4fff-a54c-fc9b7236a0c2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:15.863076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-07f9ccac-cabc-4fff-a54c-fc9b7236a0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:15.884514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b82c1-d7de-41b8-9213-8eebabfb8f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:15.885191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b82c1-d7de-41b8-9213-8eebabfb8f4b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.885476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b82c1-d7de-41b8-9213-8eebabfb8f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.885755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b82c1-d7de-41b8-9213-8eebabfb8f4b None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.886493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b82c1-d7de-41b8-9213-8eebabfb8f4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:15.886805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b82c1-d7de-41b8-9213-8eebabfb8f4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:15.888224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b82c1-d7de-41b8-9213-8eebabfb8f4b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:15.897222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 35/74] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:15.898432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36959f9-bcca-4117-89bb-e43f2d04dff2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:15.898823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36959f9-bcca-4117-89bb-e43f2d04dff2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:15.899110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36959f9-bcca-4117-89bb-e43f2d04dff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:15.915534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c36959f9-bcca-4117-89bb-e43f2d04dff2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:15.916673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c36959f9-bcca-4117-89bb-e43f2d04dff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:15.918641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:15.929815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 40/75] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:15.930640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ccac-cabc-4fff-a54c-fc9b7236a0c2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:15.933095 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:15.986680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 36/76] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:15.987529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36959f9-bcca-4117-89bb-e43f2d04dff2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:16.043128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ccac-cabc-4fff-a54c-fc9b7236a0c2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:16.076946 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e3ac-909d-4764-a095-f891f926ac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:16.077595 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e3ac-909d-4764-a095-f891f926ac9a None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:16.077879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e3ac-909d-4764-a095-f891f926ac9a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:16.078155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e3ac-909d-4764-a095-f891f926ac9a None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:16.078866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660e3ac-909d-4764-a095-f891f926ac9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:16.080334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660e3ac-909d-4764-a095-f891f926ac9a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:16.091735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36959f9-bcca-4117-89bb-e43f2d04dff2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:16.125313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822499c1-87bc-4f31-aa59-2cd7e1ed754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:16.126192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822499c1-87bc-4f31-aa59-2cd7e1ed754e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:16.126480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822499c1-87bc-4f31-aa59-2cd7e1ed754e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:16.126757 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822499c1-87bc-4f31-aa59-2cd7e1ed754e None admin] PATH_INFO: `/v3/users/11c252d8dc954906bdb78f1fc6b107f5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:16.133926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:16.142494 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822499c1-87bc-4f31-aa59-2cd7e1ed754e None admin] RBAC: Authorizing `identity:get_user(user_id=11c252d8dc954906bdb78f1fc6b107f5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:16.144009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822499c1-87bc-4f31-aa59-2cd7e1ed754e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:16.145691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 37/77] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:15 2022] GET /identity/v3/users/11c252d8dc954906bdb78f1fc6b107f5 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:16.146533 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822499c1-87bc-4f31-aa59-2cd7e1ed754e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:16.195122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 41/78] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:16:15 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:16.195992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e3ac-909d-4764-a095-f891f926ac9a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:16.257033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822499c1-87bc-4f31-aa59-2cd7e1ed754e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:16.286098 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:16.300419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a507db-8e91-4028-b82b-387857aa2d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:16.301326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a507db-8e91-4028-b82b-387857aa2d39 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:16.301615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a507db-8e91-4028-b82b-387857aa2d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:16.311718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a507db-8e91-4028-b82b-387857aa2d39 None admin] PATH_INFO: `/v3/users/11c252d8dc954906bdb78f1fc6b107f5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:16.311718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a507db-8e91-4028-b82b-387857aa2d39 None admin] RBAC: Authorizing `identity:get_user(user_id=11c252d8dc954906bdb78f1fc6b107f5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:16.311718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a507db-8e91-4028-b82b-387857aa2d39 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:16.311718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 38/79] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:16 2022] GET /identity/v3/users/11c252d8dc954906bdb78f1fc6b107f5 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:16.311718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a507db-8e91-4028-b82b-387857aa2d39 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:16.337139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e3ac-909d-4764-a095-f891f926ac9a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:16.376533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70964896-f368-429d-8029-df1386da301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:16.377635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964896-f368-429d-8029-df1386da301a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:16.378234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964896-f368-429d-8029-df1386da301a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:16.378523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964896-f368-429d-8029-df1386da301a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:16.386258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:16.394191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70964896-f368-429d-8029-df1386da301a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-70964896-f368-429d-8029-df1386da301a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:16.402235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:16.403195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:16.404054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:16.405876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 42/80] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:16:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:16.407135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70964896-f368-429d-8029-df1386da301a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:16.431715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a507db-8e91-4028-b82b-387857aa2d39 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:16.481872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c7da5-abf0-4e8e-b62a-24794c54a339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:16.482917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7da5-abf0-4e8e-b62a-24794c54a339 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:16.483472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7da5-abf0-4e8e-b62a-24794c54a339 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:16.483816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7da5-abf0-4e8e-b62a-24794c54a339 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:16.497331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c7da5-abf0-4e8e-b62a-24794c54a339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-8e5c7da5-abf0-4e8e-b62a-24794c54a339 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:16.506658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:16.507525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:16.508302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 39/81] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:16:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:16.508940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c7da5-abf0-4e8e-b62a-24794c54a339 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:16.546819 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70964896-f368-429d-8029-df1386da301a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:16.569388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:16.592752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196acb-90e4-4a33-b216-4ad1678b402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:16.594105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196acb-90e4-4a33-b216-4ad1678b402f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:16.594245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196acb-90e4-4a33-b216-4ad1678b402f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:16.594626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196acb-90e4-4a33-b216-4ad1678b402f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:16.629828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c7da5-abf0-4e8e-b62a-24794c54a339 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:16.658169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:16.671300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb7d9-526d-44f7-8595-45fcc4202f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:16.674028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb7d9-526d-44f7-8595-45fcc4202f44 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:16.674028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb7d9-526d-44f7-8595-45fcc4202f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:16.674028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb7d9-526d-44f7-8595-45fcc4202f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:16.693123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a196acb-90e4-4a33-b216-4ad1678b402f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:16.694735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a196acb-90e4-4a33-b216-4ad1678b402f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:16.744566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54eb7d9-526d-44f7-8595-45fcc4202f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:16.746309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54eb7d9-526d-44f7-8595-45fcc4202f44 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:16.809276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 43/82] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:16.810367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196acb-90e4-4a33-b216-4ad1678b402f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:16.830811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:16.852043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 40/83] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:16.853239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb7d9-526d-44f7-8595-45fcc4202f44 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:16.906639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:16.965574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196acb-90e4-4a33-b216-4ad1678b402f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:17.002040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb7d9-526d-44f7-8595-45fcc4202f44 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:17.010480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317ae3-ad43-4fed-bf6b-807cb2611692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:17.011671 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317ae3-ad43-4fed-bf6b-807cb2611692 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:17.011966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317ae3-ad43-4fed-bf6b-807cb2611692 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:17.012272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317ae3-ad43-4fed-bf6b-807cb2611692 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:17.013026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb317ae3-ad43-4fed-bf6b-807cb2611692 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:17.013339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb317ae3-ad43-4fed-bf6b-807cb2611692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:17.015628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb317ae3-ad43-4fed-bf6b-807cb2611692 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:17.025765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 44/84] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:17.026899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317ae3-ad43-4fed-bf6b-807cb2611692 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:17.051670 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d155-77b6-4744-9f52-69a9252d1fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:17.053097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d155-77b6-4744-9f52-69a9252d1fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:17.053893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d155-77b6-4744-9f52-69a9252d1fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:17.054369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d155-77b6-4744-9f52-69a9252d1fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:17.055531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78d155-77b6-4744-9f52-69a9252d1fc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:17.056344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78d155-77b6-4744-9f52-69a9252d1fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:17.057947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78d155-77b6-4744-9f52-69a9252d1fc3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:17.074715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 41/85] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:16:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:17.074715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d155-77b6-4744-9f52-69a9252d1fc3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:17.128426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:17.148050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317ae3-ad43-4fed-bf6b-807cb2611692 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:17.171496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:17.185822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835b10f-2060-4fdc-ba81-a78769fff09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:17.187112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835b10f-2060-4fdc-ba81-a78769fff09e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:17.187605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835b10f-2060-4fdc-ba81-a78769fff09e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:17.188123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835b10f-2060-4fdc-ba81-a78769fff09e None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:17.188312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d155-77b6-4744-9f52-69a9252d1fc3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:17.189718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835b10f-2060-4fdc-ba81-a78769fff09e None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:17.191365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835b10f-2060-4fdc-ba81-a78769fff09e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:17.193319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 45/86] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:17 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:17.194415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835b10f-2060-4fdc-ba81-a78769fff09e None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:17.227078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64c1f1-b5ed-4c5d-b8a2-712c7d4b095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:17.228027 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c1f1-b5ed-4c5d-b8a2-712c7d4b095f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:17.228328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c1f1-b5ed-4c5d-b8a2-712c7d4b095f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:17.228647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c1f1-b5ed-4c5d-b8a2-712c7d4b095f None admin] PATH_INFO: `/v3/projects/53433a7c21904f8fa62c62a33c9f8eac` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:17.229851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64c1f1-b5ed-4c5d-b8a2-712c7d4b095f None admin] RBAC: Authorizing `identity:get_project(project_id=53433a7c21904f8fa62c62a33c9f8eac)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:17.231560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64c1f1-b5ed-4c5d-b8a2-712c7d4b095f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:17.238810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 42/87] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:17 2022] GET /identity/v3/projects/53433a7c21904f8fa62c62a33c9f8eac => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:17.239800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64c1f1-b5ed-4c5d-b8a2-712c7d4b095f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:17.299526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835b10f-2060-4fdc-ba81-a78769fff09e None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:17.334599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7ee83-392b-4d5d-a7a2-caba3001402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:17.335802 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7ee83-392b-4d5d-a7a2-caba3001402e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:17.336320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7ee83-392b-4d5d-a7a2-caba3001402e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:17.336791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7ee83-392b-4d5d-a7a2-caba3001402e None admin] PATH_INFO: `/v3/users/a30ed168831044238fab0d0dd5d1bd65` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:17.338198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7ee83-392b-4d5d-a7a2-caba3001402e None admin] RBAC: Authorizing `identity:get_user(user_id=a30ed168831044238fab0d0dd5d1bd65)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:17.339992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7ee83-392b-4d5d-a7a2-caba3001402e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:17.341998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 46/88] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:17 2022] GET /identity/v3/users/a30ed168831044238fab0d0dd5d1bd65 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:17.343467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7ee83-392b-4d5d-a7a2-caba3001402e None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:17.361569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64c1f1-b5ed-4c5d-b8a2-712c7d4b095f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:17.365684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:17.398962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6361193-5668-4b98-abb8-9e8ae4a370e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:17.399864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6361193-5668-4b98-abb8-9e8ae4a370e6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:17.400207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6361193-5668-4b98-abb8-9e8ae4a370e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:17.400491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6361193-5668-4b98-abb8-9e8ae4a370e6 None admin] PATH_INFO: `/v3/users/11c252d8dc954906bdb78f1fc6b107f5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:17.401755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6361193-5668-4b98-abb8-9e8ae4a370e6 None admin] RBAC: Authorizing `identity:get_user(user_id=11c252d8dc954906bdb78f1fc6b107f5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:17.403234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6361193-5668-4b98-abb8-9e8ae4a370e6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:17.405258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 43/89] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:17 2022] GET /identity/v3/users/11c252d8dc954906bdb78f1fc6b107f5 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:17.409638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6361193-5668-4b98-abb8-9e8ae4a370e6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:17.435383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:17.460388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7ee83-392b-4d5d-a7a2-caba3001402e None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:17.496723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc6e03-1e92-4fa8-8067-aa5dddd8079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:17.497770 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc6e03-1e92-4fa8-8067-aa5dddd8079c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:17.498304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc6e03-1e92-4fa8-8067-aa5dddd8079c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:17.498786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc6e03-1e92-4fa8-8067-aa5dddd8079c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:17.500002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc6e03-1e92-4fa8-8067-aa5dddd8079c None admin] RBAC: Adding query filter params (role.id=14542129036041fa85f7c5223487670d, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8, user.id=11c252d8dc954906bdb78f1fc6b107f5) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:17.500597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc6e03-1e92-4fa8-8067-aa5dddd8079c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:17.502383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc6e03-1e92-4fa8-8067-aa5dddd8079c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:17.509004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 47/90] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:17 2022] GET /identity/v3/role_assignments?user.id=11c252d8dc954906bdb78f1fc6b107f5&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=14542129036041fa85f7c5223487670d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:17.510032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc6e03-1e92-4fa8-8067-aa5dddd8079c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:17.526879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6361193-5668-4b98-abb8-9e8ae4a370e6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:17.606586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d464037-e2c3-4de6-a7d3-fe9b625e1060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:17.608859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d464037-e2c3-4de6-a7d3-fe9b625e1060 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:17.609149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d464037-e2c3-4de6-a7d3-fe9b625e1060 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:17.609436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d464037-e2c3-4de6-a7d3-fe9b625e1060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:17.610287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d464037-e2c3-4de6-a7d3-fe9b625e1060 None admin] RBAC: Adding query filter params (role.id=14542129036041fa85f7c5223487670d, scope.project.id=53433a7c21904f8fa62c62a33c9f8eac, user.id=11c252d8dc954906bdb78f1fc6b107f5) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:17.611474 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d464037-e2c3-4de6-a7d3-fe9b625e1060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:17.613035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d464037-e2c3-4de6-a7d3-fe9b625e1060 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:17.637682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 44/91] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:17 2022] GET /identity/v3/role_assignments?user.id=11c252d8dc954906bdb78f1fc6b107f5&scope.project.id=53433a7c21904f8fa62c62a33c9f8eac&role.id=14542129036041fa85f7c5223487670d => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:17.638713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d464037-e2c3-4de6-a7d3-fe9b625e1060 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:17.673183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:17.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc6e03-1e92-4fa8-8067-aa5dddd8079c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:17.796823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f3f0-34fa-4e55-bd64-008c7ea726fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:17.797508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f3f0-34fa-4e55-bd64-008c7ea726fa None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:17.797801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f3f0-34fa-4e55-bd64-008c7ea726fa None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:17.798085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f3f0-34fa-4e55-bd64-008c7ea726fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:17.836527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:17.870193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d464037-e2c3-4de6-a7d3-fe9b625e1060 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:17.932189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f3f0-34fa-4e55-bd64-008c7ea726fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:17.933709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f3f0-34fa-4e55-bd64-008c7ea726fa None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:17.936967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70ad4-50a1-45b1-8ca7-117cdfb02fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:17.938064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70ad4-50a1-45b1-8ca7-117cdfb02fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:17.938563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70ad4-50a1-45b1-8ca7-117cdfb02fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:17.939043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70ad4-50a1-45b1-8ca7-117cdfb02fe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:18.047337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:18.080329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 48/92] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:18.085207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f3f0-34fa-4e55-bd64-008c7ea726fa None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:18.096045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e70ad4-50a1-45b1-8ca7-117cdfb02fe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:18.098941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e70ad4-50a1-45b1-8ca7-117cdfb02fe7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:18.204246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:18.223786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 45/93] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:18.233330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70ad4-50a1-45b1-8ca7-117cdfb02fe7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:18.277001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f3f0-34fa-4e55-bd64-008c7ea726fa None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:18.333396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050356d-3bb5-4e85-b8f7-e336c22f1c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:18.334963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050356d-3bb5-4e85-b8f7-e336c22f1c36 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:18.335398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050356d-3bb5-4e85-b8f7-e336c22f1c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:18.335848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050356d-3bb5-4e85-b8f7-e336c22f1c36 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:18.339895 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050356d-3bb5-4e85-b8f7-e336c22f1c36 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:18.345000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050356d-3bb5-4e85-b8f7-e336c22f1c36 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:18.347102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 49/94] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:18 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:18.370094 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050356d-3bb5-4e85-b8f7-e336c22f1c36 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:18.404108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70ad4-50a1-45b1-8ca7-117cdfb02fe7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:18.457967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e6bcf-b664-4aab-9091-525792513867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:18.459101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6bcf-b664-4aab-9091-525792513867 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:18.459524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6bcf-b664-4aab-9091-525792513867 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:18.459930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6bcf-b664-4aab-9091-525792513867 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:18.461310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e6bcf-b664-4aab-9091-525792513867 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:18.462916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e6bcf-b664-4aab-9091-525792513867 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:18.465178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 46/95] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:18 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:18.471683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e6bcf-b664-4aab-9091-525792513867 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:18.488121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:18.552728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:18.603015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e6bcf-b664-4aab-9091-525792513867 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:18.612489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050356d-3bb5-4e85-b8f7-e336c22f1c36 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:18.656682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b75c1-d457-422d-abe1-731acc461332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:18.657629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b75c1-d457-422d-abe1-731acc461332 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:18.658093 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b75c1-d457-422d-abe1-731acc461332 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:18.658501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b75c1-d457-422d-abe1-731acc461332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:18.659454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b75c1-d457-422d-abe1-731acc461332 None admin] RBAC: Adding query filter params (role.id=fd4cb9f5c4fb444498c049489198e975, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8, user.id=11c252d8dc954906bdb78f1fc6b107f5) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:18.659899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b75c1-d457-422d-abe1-731acc461332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:18.661500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b75c1-d457-422d-abe1-731acc461332 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:18.676806 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 47/96] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:18 2022] GET /identity/v3/role_assignments?user.id=11c252d8dc954906bdb78f1fc6b107f5&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=fd4cb9f5c4fb444498c049489198e975 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:18.689447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c975a-8936-49d3-b3ed-a1f77518206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:18.690424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c975a-8936-49d3-b3ed-a1f77518206b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:18.690867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c975a-8936-49d3-b3ed-a1f77518206b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:18.691291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c975a-8936-49d3-b3ed-a1f77518206b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:18.692379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c975a-8936-49d3-b3ed-a1f77518206b None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8, user.id=a30ed168831044238fab0d0dd5d1bd65) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:18.692879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c975a-8936-49d3-b3ed-a1f77518206b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:18.694545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c975a-8936-49d3-b3ed-a1f77518206b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:18.707072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 50/97] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:18 2022] GET /identity/v3/role_assignments?user.id=a30ed168831044238fab0d0dd5d1bd65&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:18.871719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce76de-1711-4bdb-aa4b-5a9c8a5c2c20 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:18.872055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce76de-1711-4bdb-aa4b-5a9c8a5c2c20 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:18.872249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce76de-1711-4bdb-aa4b-5a9c8a5c2c20 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:18.873799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 48/98] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:18.881488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0b3f-14c8-4046-a083-2564c06e4d10 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:18.881488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0b3f-14c8-4046-a083-2564c06e4d10 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:18.881488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0b3f-14c8-4046-a083-2564c06e4d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:18.899980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-5c7d0b3f-14c8-4046-a083-2564c06e4d10 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:18.901590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5c7d0b3f-14c8-4046-a083-2564c06e4d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:18.983304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 51/99] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:19.007180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce76de-1711-4bdb-aa4b-5a9c8a5c2c20 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:19.129698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce76de-1711-4bdb-aa4b-5a9c8a5c2c20 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:19.145964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d015e-6942-442b-b937-0a2f223ba0d0 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:19.146560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d015e-6942-442b-b937-0a2f223ba0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:19.147036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d015e-6942-442b-b937-0a2f223ba0d0 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:19.148681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 52/100] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:19.153959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80828b1a-8f36-4338-9453-e27360061b02 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:19.154585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80828b1a-8f36-4338-9453-e27360061b02 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:19.155059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80828b1a-8f36-4338-9453-e27360061b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:19.156449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:19.178635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b5d2e-aebd-49b6-88f8-48c3b7ca3002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:19.179508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b5d2e-aebd-49b6-88f8-48c3b7ca3002 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:19.179613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-80828b1a-8f36-4338-9453-e27360061b02 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:19.179797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b5d2e-aebd-49b6-88f8-48c3b7ca3002 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:19.180112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b5d2e-aebd-49b6-88f8-48c3b7ca3002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:19.181381 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b5d2e-aebd-49b6-88f8-48c3b7ca3002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:19.181626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-80828b1a-8f36-4338-9453-e27360061b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:19.182890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b5d2e-aebd-49b6-88f8-48c3b7ca3002 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:19.185115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 49/101] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:19.191385 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b5d2e-aebd-49b6-88f8-48c3b7ca3002 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:19.221163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:19.256937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 53/102] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:19.281757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80828b1a-8f36-4338-9453-e27360061b02 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:19.337043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b5d2e-aebd-49b6-88f8-48c3b7ca3002 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:19.411920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3622e6-607e-402e-bad3-0d0a874eb9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:19.414899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3622e6-607e-402e-bad3-0d0a874eb9f4 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:19.415392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3622e6-607e-402e-bad3-0d0a874eb9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:19.416484 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3622e6-607e-402e-bad3-0d0a874eb9f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:19.417302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3622e6-607e-402e-bad3-0d0a874eb9f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:19.419441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3622e6-607e-402e-bad3-0d0a874eb9f4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:19.471971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80828b1a-8f36-4338-9453-e27360061b02 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:19.523273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdb67b-8b36-4f33-b4b7-b29fdabe5f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:19.524114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb67b-8b36-4f33-b4b7-b29fdabe5f4a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:19.524417 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb67b-8b36-4f33-b4b7-b29fdabe5f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:19.524732 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb67b-8b36-4f33-b4b7-b29fdabe5f4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:19.534820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 50/103] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:16:19 2022] POST /identity/v3/projects => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:16:19.553116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdb67b-8b36-4f33-b4b7-b29fdabe5f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-55cdb67b-8b36-4f33-b4b7-b29fdabe5f4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:19.561292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:19.562197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:19.562969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 54/104] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:19.570316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3622e6-607e-402e-bad3-0d0a874eb9f4 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:19.660272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:19.730728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3622e6-607e-402e-bad3-0d0a874eb9f4 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:19.766882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2bb7b-a2df-4920-a2da-6c26bddc3e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:19.767832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2bb7b-a2df-4920-a2da-6c26bddc3e90 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:19.768304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2bb7b-a2df-4920-a2da-6c26bddc3e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:19.768722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2bb7b-a2df-4920-a2da-6c26bddc3e90 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:19.769617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2bb7b-a2df-4920-a2da-6c26bddc3e90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:19.770064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2bb7b-a2df-4920-a2da-6c26bddc3e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:19.771587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2bb7b-a2df-4920-a2da-6c26bddc3e90 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:19.781999 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 51/105] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:19.787807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdb67b-8b36-4f33-b4b7-b29fdabe5f4a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:19.830996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:19.956577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdb67b-8b36-4f33-b4b7-b29fdabe5f4a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:19.998759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c1ad-d569-415b-ab17-19490f5aa9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:19.999682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c1ad-d569-415b-ab17-19490f5aa9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:19.999969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c1ad-d569-415b-ab17-19490f5aa9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:20.000274 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c1ad-d569-415b-ab17-19490f5aa9d3 None admin] PATH_INFO: `/v3/users/cf26fe88ac274365bfd06ef0c9b8fb89` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:20.018288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7c1ad-d569-415b-ab17-19490f5aa9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cf26fe88ac274365bfd06ef0c9b8fb89)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:20.019752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7c1ad-d569-415b-ab17-19490f5aa9d3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:20.021737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 55/106] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:19 2022] GET /identity/v3/users/cf26fe88ac274365bfd06ef0c9b8fb89 => generated 289 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:20.027418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2bb7b-a2df-4920-a2da-6c26bddc3e90 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:20.140714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:20.144697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2bb7b-a2df-4920-a2da-6c26bddc3e90 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:20.185272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b4e13-6b4c-443d-9212-bf8de0144cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:20.186105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4e13-6b4c-443d-9212-bf8de0144cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:20.186415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4e13-6b4c-443d-9212-bf8de0144cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:20.186698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4e13-6b4c-443d-9212-bf8de0144cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:20.270169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b4e13-6b4c-443d-9212-bf8de0144cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:20.271577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b4e13-6b4c-443d-9212-bf8de0144cd0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:20.394370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:20.399513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 52/107] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:20.407168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c1ad-d569-415b-ab17-19490f5aa9d3 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:20.539630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:20.553582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c1ad-d569-415b-ab17-19490f5aa9d3 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:20.609105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef602ef4-ccb0-4863-a323-844f7d9dfe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:20.609988 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef602ef4-ccb0-4863-a323-844f7d9dfe92 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:20.610277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef602ef4-ccb0-4863-a323-844f7d9dfe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:20.610554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef602ef4-ccb0-4863-a323-844f7d9dfe92 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:20.617087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef602ef4-ccb0-4863-a323-844f7d9dfe92 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:20.618717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef602ef4-ccb0-4863-a323-844f7d9dfe92 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:20.620586 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 56/108] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:20 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:20.626842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b4e13-6b4c-443d-9212-bf8de0144cd0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:20.713773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da9162-eb9a-49d3-8690-8073720c65eb None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:20.714085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da9162-eb9a-49d3-8690-8073720c65eb None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:20.714341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da9162-eb9a-49d3-8690-8073720c65eb None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:20.715860 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 57/109] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:20.722469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e415e6a-91a1-4cb1-8584-d74bda549043 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:20.722760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e415e6a-91a1-4cb1-8584-d74bda549043 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:20.723045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e415e6a-91a1-4cb1-8584-d74bda549043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:20.752346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4e415e6a-91a1-4cb1-8584-d74bda549043 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:20.753539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4e415e6a-91a1-4cb1-8584-d74bda549043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:20.790864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b4e13-6b4c-443d-9212-bf8de0144cd0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:20.851206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3d97a-d530-4c29-850b-f2e687999471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:20.851884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3d97a-d530-4c29-850b-f2e687999471 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:20.852198 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3d97a-d530-4c29-850b-f2e687999471 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:20.852482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3d97a-d530-4c29-850b-f2e687999471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:20.853308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3d97a-d530-4c29-850b-f2e687999471 None admin] RBAC: Adding query filter params (role.id=7050c29529de40c183462f4e9474abcf, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8, user.id=cf26fe88ac274365bfd06ef0c9b8fb89) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:20.853626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3d97a-d530-4c29-850b-f2e687999471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:20.855072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3d97a-d530-4c29-850b-f2e687999471 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:20.865511 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 53/110] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:20 2022] GET /identity/v3/role_assignments?user.id=cf26fe88ac274365bfd06ef0c9b8fb89&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=7050c29529de40c183462f4e9474abcf => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:20.929436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 58/111] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:20.960323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3d97a-d530-4c29-850b-f2e687999471 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:21.044453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:21.097516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3d97a-d530-4c29-850b-f2e687999471 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:21.143667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5367c37-6413-4dea-8094-65a07fa7e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:21.144585 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5367c37-6413-4dea-8094-65a07fa7e0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:21.144870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5367c37-6413-4dea-8094-65a07fa7e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:21.145144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5367c37-6413-4dea-8094-65a07fa7e0e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:21.163594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5367c37-6413-4dea-8094-65a07fa7e0e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:21.164524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144e17d-072c-4599-8ff2-0666c76cb97c None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:21.164838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144e17d-072c-4599-8ff2-0666c76cb97c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:21.165144 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144e17d-072c-4599-8ff2-0666c76cb97c None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:21.166617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 59/112] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-e5367c37-6413-4dea-8094-65a07fa7e0e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:21.172043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:21.172932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:21.174134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 54/113] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:21.179811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02738f6-79f4-4e9b-99cd-c6b2f35b240a None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:21.180133 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02738f6-79f4-4e9b-99cd-c6b2f35b240a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:21.180427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02738f6-79f4-4e9b-99cd-c6b2f35b240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:21.182610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5367c37-6413-4dea-8094-65a07fa7e0e6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:21.224224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-c02738f6-79f4-4e9b-99cd-c6b2f35b240a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:21.225448 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c02738f6-79f4-4e9b-99cd-c6b2f35b240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:21.349047 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5367c37-6413-4dea-8094-65a07fa7e0e6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:21.374823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:21.387376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349359d-bb1c-4bcb-ba08-b3fd4cc60d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:21.387573 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 60/114] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:21.389062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349359d-bb1c-4bcb-ba08-b3fd4cc60d01 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:21.389814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349359d-bb1c-4bcb-ba08-b3fd4cc60d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:21.390300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349359d-bb1c-4bcb-ba08-b3fd4cc60d01 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:21.391200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349359d-bb1c-4bcb-ba08-b3fd4cc60d01 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:21.392161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349359d-bb1c-4bcb-ba08-b3fd4cc60d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:21.398409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349359d-bb1c-4bcb-ba08-b3fd4cc60d01 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:21.404199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 55/115] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:21.412103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02738f6-79f4-4e9b-99cd-c6b2f35b240a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:21.421440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349359d-bb1c-4bcb-ba08-b3fd4cc60d01 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:21.446214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:21.575473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02738f6-79f4-4e9b-99cd-c6b2f35b240a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:21.609009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349359d-bb1c-4bcb-ba08-b3fd4cc60d01 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:21.621176 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9a771-c454-44a6-81fb-c979875279d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:21.622081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9a771-c454-44a6-81fb-c979875279d6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:21.622370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9a771-c454-44a6-81fb-c979875279d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:21.622653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9a771-c454-44a6-81fb-c979875279d6 None admin] PATH_INFO: `/v3/users/11c252d8dc954906bdb78f1fc6b107f5` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:21.624772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9a771-c454-44a6-81fb-c979875279d6 None admin] RBAC: Authorizing `identity:get_user(user_id=11c252d8dc954906bdb78f1fc6b107f5)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:21.626439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9a771-c454-44a6-81fb-c979875279d6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:21.628497 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 61/116] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:21 2022] GET /identity/v3/users/11c252d8dc954906bdb78f1fc6b107f5 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:21.634030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9a771-c454-44a6-81fb-c979875279d6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:21.657733 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047d37c-32be-4af3-8855-ba897cc0e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:21.658567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047d37c-32be-4af3-8855-ba897cc0e3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:21.658855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047d37c-32be-4af3-8855-ba897cc0e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:21.659137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047d37c-32be-4af3-8855-ba897cc0e3a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:21.675264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047d37c-32be-4af3-8855-ba897cc0e3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-4047d37c-32be-4af3-8855-ba897cc0e3a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:21.683057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:21.683912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:21.684725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:21.692796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 56/117] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:21.710589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047d37c-32be-4af3-8855-ba897cc0e3a2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:21.738362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:21.767483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:21.770222 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9a771-c454-44a6-81fb-c979875279d6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:21.842293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2b88f-c03f-4e17-81e5-599044593633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:21.843579 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2b88f-c03f-4e17-81e5-599044593633 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:21.844009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2b88f-c03f-4e17-81e5-599044593633 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:21.844510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2b88f-c03f-4e17-81e5-599044593633 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:21.845929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2b88f-c03f-4e17-81e5-599044593633 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:21.847559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2b88f-c03f-4e17-81e5-599044593633 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:21.855554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 62/118] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:21 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:21.857080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2b88f-c03f-4e17-81e5-599044593633 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:21.891340 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047d37c-32be-4af3-8855-ba897cc0e3a2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:21.985915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db173800-2dbf-47de-8f45-647568f26233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:21.986799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db173800-2dbf-47de-8f45-647568f26233 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:21.987183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db173800-2dbf-47de-8f45-647568f26233 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:21.987589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db173800-2dbf-47de-8f45-647568f26233 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:21.988696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db173800-2dbf-47de-8f45-647568f26233 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:21.989121 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db173800-2dbf-47de-8f45-647568f26233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:21.990673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db173800-2dbf-47de-8f45-647568f26233 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:22.010499 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 57/119] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:22.019580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db173800-2dbf-47de-8f45-647568f26233 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:22.052528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2b88f-c03f-4e17-81e5-599044593633 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:22.097689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623bbb4-3a3a-4a71-a070-37d932e3904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:22.099950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623bbb4-3a3a-4a71-a070-37d932e3904f None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:22.101074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623bbb4-3a3a-4a71-a070-37d932e3904f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:22.102041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623bbb4-3a3a-4a71-a070-37d932e3904f None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/users/11c252d8dc954906bdb78f1fc6b107f5/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:22.106391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623bbb4-3a3a-4a71-a070-37d932e3904f None admin] RBAC: Authorizing `identity:create_grant(project_id=e273488503ac4eb5afd7c77c4bdd34c8, user_id=11c252d8dc954906bdb78f1fc6b107f5, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:22.108346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623bbb4-3a3a-4a71-a070-37d932e3904f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:22.181511 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db173800-2dbf-47de-8f45-647568f26233 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:22.192279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:22.217351 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05154cc0-c5a4-4033-a6b8-6f6b38dbf165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:22.218236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154cc0-c5a4-4033-a6b8-6f6b38dbf165 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:22.218521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154cc0-c5a4-4033-a6b8-6f6b38dbf165 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:22.218796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154cc0-c5a4-4033-a6b8-6f6b38dbf165 None admin] PATH_INFO: `/v3/users/11c252d8dc954906bdb78f1fc6b107f5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:22.220001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05154cc0-c5a4-4033-a6b8-6f6b38dbf165 None admin] RBAC: Authorizing `identity:get_user(user_id=11c252d8dc954906bdb78f1fc6b107f5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:22.221617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05154cc0-c5a4-4033-a6b8-6f6b38dbf165 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:22.223248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 58/120] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:22 2022] GET /identity/v3/users/11c252d8dc954906bdb78f1fc6b107f5 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:22.228030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f081-193a-4705-b316-2d2c019fdc7d None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:22.228030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f081-193a-4705-b316-2d2c019fdc7d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:22.228030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f081-193a-4705-b316-2d2c019fdc7d None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:22.228030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 59/121] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:22.228030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea66463-4445-4597-bc75-11c3690f421f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:22.228030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea66463-4445-4597-bc75-11c3690f421f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:22.228464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea66463-4445-4597-bc75-11c3690f421f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:22.229240 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 60/122] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:22.229949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea66463-4445-4597-bc75-11c3690f421f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:22.253663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 63/123] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:16:21 2022] PUT /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/users/11c252d8dc954906bdb78f1fc6b107f5/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:16:22.254514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1444da-eff3-46c1-af60-6266b4ea359b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:22.254814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1444da-eff3-46c1-af60-6266b4ea359b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:22.255156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1444da-eff3-46c1-af60-6266b4ea359b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:22.299703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-eb1444da-eff3-46c1-af60-6266b4ea359b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:22.302957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-eb1444da-eff3-46c1-af60-6266b4ea359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:22.339177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:22.448865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 64/124] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:22.450177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225770-8b66-4cb4-9f6c-412cd9bc483d None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:22.450494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225770-8b66-4cb4-9f6c-412cd9bc483d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:22.450801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225770-8b66-4cb4-9f6c-412cd9bc483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:22.451108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea66463-4445-4597-bc75-11c3690f421f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:22.469738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-77225770-8b66-4cb4-9f6c-412cd9bc483d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:22.469912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-77225770-8b66-4cb4-9f6c-412cd9bc483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:22.493686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054db0bc-2002-4686-92a3-3233e8710685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:22.495045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db0bc-2002-4686-92a3-3233e8710685 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:22.495572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db0bc-2002-4686-92a3-3233e8710685 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:22.496192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db0bc-2002-4686-92a3-3233e8710685 None admin] PATH_INFO: `/v3/projects/53433a7c21904f8fa62c62a33c9f8eac` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:22.497595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054db0bc-2002-4686-92a3-3233e8710685 None admin] RBAC: Authorizing `identity:get_project(project_id=53433a7c21904f8fa62c62a33c9f8eac)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:22.500502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054db0bc-2002-4686-92a3-3233e8710685 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:22.505799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 61/125] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:22 2022] GET /identity/v3/projects/53433a7c21904f8fa62c62a33c9f8eac => generated 312 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:22.507241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054db0bc-2002-4686-92a3-3233e8710685 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:22.552511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 65/126] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:22.552511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225770-8b66-4cb4-9f6c-412cd9bc483d None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:22.580420 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:22.679299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054db0bc-2002-4686-92a3-3233e8710685 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:22.696862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:22.740286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225770-8b66-4cb4-9f6c-412cd9bc483d None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:22.740455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd51d5-a896-4248-8514-64f7c880c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:22.740455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd51d5-a896-4248-8514-64f7c880c725 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:22.740455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd51d5-a896-4248-8514-64f7c880c725 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:22.740455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd51d5-a896-4248-8514-64f7c880c725 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:22.740738 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd51d5-a896-4248-8514-64f7c880c725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5acd51d5-a896-4248-8514-64f7c880c725 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:22.747765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:22.748819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:22.749616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 62/127] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:16:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:22.750349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd51d5-a896-4248-8514-64f7c880c725 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:22.758496 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98975-884c-4651-98e2-ded6f8a60910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:22.759763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98975-884c-4651-98e2-ded6f8a60910 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:22.760301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98975-884c-4651-98e2-ded6f8a60910 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:22.760787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98975-884c-4651-98e2-ded6f8a60910 None admin] PATH_INFO: `/v3/projects/53433a7c21904f8fa62c62a33c9f8eac/users/11c252d8dc954906bdb78f1fc6b107f5/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:22.763179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa98975-884c-4651-98e2-ded6f8a60910 None admin] RBAC: Authorizing `identity:create_grant(project_id=53433a7c21904f8fa62c62a33c9f8eac, user_id=11c252d8dc954906bdb78f1fc6b107f5, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:22.765665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa98975-884c-4651-98e2-ded6f8a60910 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:22.859122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 66/128] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:16:22 2022] PUT /identity/v3/projects/53433a7c21904f8fa62c62a33c9f8eac/users/11c252d8dc954906bdb78f1fc6b107f5/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:16:22.860474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98975-884c-4651-98e2-ded6f8a60910 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:22.910809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd51d5-a896-4248-8514-64f7c880c725 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:22.919256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:22.980953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1e5d-8ea7-47fe-839a-00e07cd8f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:22.981864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1e5d-8ea7-47fe-839a-00e07cd8f24e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:22.982152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1e5d-8ea7-47fe-839a-00e07cd8f24e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:22.983214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1e5d-8ea7-47fe-839a-00e07cd8f24e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:22.998274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a1e5d-8ea7-47fe-839a-00e07cd8f24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7e6a1e5d-8ea7-47fe-839a-00e07cd8f24e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:23.007628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:23.008603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:23.009367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 63/129] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:16:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:23.016204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1e5d-8ea7-47fe-839a-00e07cd8f24e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:23.061150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98975-884c-4651-98e2-ded6f8a60910 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:23.100506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab9b24-ea61-4572-8f05-e92d90131300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:23.101290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab9b24-ea61-4572-8f05-e92d90131300 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:23.101597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab9b24-ea61-4572-8f05-e92d90131300 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:23.101896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab9b24-ea61-4572-8f05-e92d90131300 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:23.102763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab9b24-ea61-4572-8f05-e92d90131300 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:23.103093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab9b24-ea61-4572-8f05-e92d90131300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:23.104692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab9b24-ea61-4572-8f05-e92d90131300 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:23.106419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:23.116032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 67/130] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:23.125701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab9b24-ea61-4572-8f05-e92d90131300 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:23.226271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1e5d-8ea7-47fe-839a-00e07cd8f24e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:23.266932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78927d-e294-4cb3-abbe-9b188d72d7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:23.267541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78927d-e294-4cb3-abbe-9b188d72d7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:23.267831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78927d-e294-4cb3-abbe-9b188d72d7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:23.268134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78927d-e294-4cb3-abbe-9b188d72d7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:23.269008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78927d-e294-4cb3-abbe-9b188d72d7f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:23.269373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78927d-e294-4cb3-abbe-9b188d72d7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:23.270880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78927d-e294-4cb3-abbe-9b188d72d7f3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:23.281927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 64/131] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:16:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:23.283300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6031bd-eb4b-4a46-b5b9-41a7e374f4ce None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:23.283599 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6031bd-eb4b-4a46-b5b9-41a7e374f4ce None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:23.283888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6031bd-eb4b-4a46-b5b9-41a7e374f4ce None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:23.285925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 65/132] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:23.291716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9e10d-ace5-42e4-b8be-7aac1933ede5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:23.292169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9e10d-ace5-42e4-b8be-7aac1933ede5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:23.292555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9e10d-ace5-42e4-b8be-7aac1933ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:23.301235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab9b24-ea61-4572-8f05-e92d90131300 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:23.313716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-31b9e10d-ace5-42e4-b8be-7aac1933ede5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:23.314948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-31b9e10d-ace5-42e4-b8be-7aac1933ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:23.340474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62ce2d-fa98-4fca-a983-22392345bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:23.341496 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ce2d-fa98-4fca-a983-22392345bf7a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:23.342414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ce2d-fa98-4fca-a983-22392345bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:23.342699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ce2d-fa98-4fca-a983-22392345bf7a None admin] PATH_INFO: `/v3/users/a30ed168831044238fab0d0dd5d1bd65` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:23.344025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62ce2d-fa98-4fca-a983-22392345bf7a None admin] RBAC: Authorizing `identity:get_user(user_id=a30ed168831044238fab0d0dd5d1bd65)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:23.345688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62ce2d-fa98-4fca-a983-22392345bf7a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:23.347538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 68/133] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:23 2022] GET /identity/v3/users/a30ed168831044238fab0d0dd5d1bd65 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:23.348380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62ce2d-fa98-4fca-a983-22392345bf7a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:23.368440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:23.408498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 66/134] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:23.409985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9e10d-ace5-42e4-b8be-7aac1933ede5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:23.437328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:23.481394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62ce2d-fa98-4fca-a983-22392345bf7a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:23.523841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdf3f6-aa06-4fb7-a7d1-cd871f09db5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:23.525045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdf3f6-aa06-4fb7-a7d1-cd871f09db5c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:23.525529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdf3f6-aa06-4fb7-a7d1-cd871f09db5c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:23.525965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdf3f6-aa06-4fb7-a7d1-cd871f09db5c None admin] PATH_INFO: `/v3/users/11c252d8dc954906bdb78f1fc6b107f5` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:23.527539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdf3f6-aa06-4fb7-a7d1-cd871f09db5c None admin] RBAC: Authorizing `identity:get_user(user_id=11c252d8dc954906bdb78f1fc6b107f5)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:23.529721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdf3f6-aa06-4fb7-a7d1-cd871f09db5c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:23.531944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 69/135] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:23 2022] GET /identity/v3/users/11c252d8dc954906bdb78f1fc6b107f5 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:23.532830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdf3f6-aa06-4fb7-a7d1-cd871f09db5c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:23.539551 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9e10d-ace5-42e4-b8be-7aac1933ede5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:23.588823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218c002-4c09-4784-8323-a49f18eeea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:23.590041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c002-4c09-4784-8323-a49f18eeea42 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:23.590597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c002-4c09-4784-8323-a49f18eeea42 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:23.591055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c002-4c09-4784-8323-a49f18eeea42 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:23.592739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218c002-4c09-4784-8323-a49f18eeea42 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:23.594963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218c002-4c09-4784-8323-a49f18eeea42 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:23.597311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 67/136] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:23 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:23.598516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218c002-4c09-4784-8323-a49f18eeea42 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:23.637259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:23.692636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdf3f6-aa06-4fb7-a7d1-cd871f09db5c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:23.753964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:23.763325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218c002-4c09-4784-8323-a49f18eeea42 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:23.768802 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd267b-8c77-416b-b24b-184acb139d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:23.769906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd267b-8c77-416b-b24b-184acb139d84 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:23.770374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd267b-8c77-416b-b24b-184acb139d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:23.770829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd267b-8c77-416b-b24b-184acb139d84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:23.772641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd267b-8c77-416b-b24b-184acb139d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:23.774552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd267b-8c77-416b-b24b-184acb139d84 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:23.776517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 70/137] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:23.777498 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd267b-8c77-416b-b24b-184acb139d84 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:23.803309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bcfcf-1c6b-4f29-b230-e249161569c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:23.804274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bcfcf-1c6b-4f29-b230-e249161569c3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:23.804563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bcfcf-1c6b-4f29-b230-e249161569c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:23.804885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bcfcf-1c6b-4f29-b230-e249161569c3 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:23.806211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20bcfcf-1c6b-4f29-b230-e249161569c3 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:23.807692 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20bcfcf-1c6b-4f29-b230-e249161569c3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:23.809840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 68/138] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:23 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:23.810649 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bcfcf-1c6b-4f29-b230-e249161569c3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:23.958096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:23.971292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bcfcf-1c6b-4f29-b230-e249161569c3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:23.987561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd267b-8c77-416b-b24b-184acb139d84 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:24.029604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caf50e-4754-4f56-afed-88e3de71a859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:24.030793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caf50e-4754-4f56-afed-88e3de71a859 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:24.031085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caf50e-4754-4f56-afed-88e3de71a859 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:24.031369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caf50e-4754-4f56-afed-88e3de71a859 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/users/a30ed168831044238fab0d0dd5d1bd65/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:24.033511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caf50e-4754-4f56-afed-88e3de71a859 None admin] RBAC: Authorizing `identity:create_grant(project_id=e273488503ac4eb5afd7c77c4bdd34c8, user_id=a30ed168831044238fab0d0dd5d1bd65, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:24.035138 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caf50e-4754-4f56-afed-88e3de71a859 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:24.052919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49e90d-8443-4319-95db-06c6c9ea1c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:24.053641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e90d-8443-4319-95db-06c6c9ea1c19 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:24.053927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e90d-8443-4319-95db-06c6c9ea1c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:24.054277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e90d-8443-4319-95db-06c6c9ea1c19 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:24.055047 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49e90d-8443-4319-95db-06c6c9ea1c19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:24.056665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49e90d-8443-4319-95db-06c6c9ea1c19 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:24.122774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 71/139] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:16:23 2022] PUT /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/users/a30ed168831044238fab0d0dd5d1bd65/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:16:24.124488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caf50e-4754-4f56-afed-88e3de71a859 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:24.173767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 69/140] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:16:23 2022] POST /identity/v3/users => generated 283 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:24.219755 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:24.284705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caf50e-4754-4f56-afed-88e3de71a859 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:24.331613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081381-d6e0-47af-848a-7114318d7518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:24.332574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081381-d6e0-47af-848a-7114318d7518 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:24.332864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081381-d6e0-47af-848a-7114318d7518 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:24.333150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081381-d6e0-47af-848a-7114318d7518 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/users/11c252d8dc954906bdb78f1fc6b107f5/roles/fd4cb9f5c4fb444498c049489198e975` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:24.335485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081381-d6e0-47af-848a-7114318d7518 None admin] RBAC: Authorizing `identity:create_grant(project_id=e273488503ac4eb5afd7c77c4bdd34c8, user_id=11c252d8dc954906bdb78f1fc6b107f5, role_id=fd4cb9f5c4fb444498c049489198e975)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:24.337062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081381-d6e0-47af-848a-7114318d7518 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:24.344802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fe6a0-a1e8-4c83-b1da-398409413b99 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:24.345093 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fe6a0-a1e8-4c83-b1da-398409413b99 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:24.345379 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fe6a0-a1e8-4c83-b1da-398409413b99 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:24.346759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 70/141] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:24.353399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835021-4538-4cd2-9d47-d2ac9931aa7d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:24.353684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835021-4538-4cd2-9d47-d2ac9931aa7d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:24.353965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835021-4538-4cd2-9d47-d2ac9931aa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:24.377997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2f835021-4538-4cd2-9d47-d2ac9931aa7d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:24.379264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2f835021-4538-4cd2-9d47-d2ac9931aa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:24.468543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 71/142] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:24.481257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 72/143] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:16:24 2022] PUT /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/users/11c252d8dc954906bdb78f1fc6b107f5/roles/fd4cb9f5c4fb444498c049489198e975 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:16:24.499630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f835021-4538-4cd2-9d47-d2ac9931aa7d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:24.616315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:24.646347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f835021-4538-4cd2-9d47-d2ac9931aa7d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:24.694488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87d7e2-5632-4041-b9ff-3cec35796176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:24.695312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d7e2-5632-4041-b9ff-3cec35796176 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:24.695597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d7e2-5632-4041-b9ff-3cec35796176 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:24.695874 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d7e2-5632-4041-b9ff-3cec35796176 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:24.717091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87d7e2-5632-4041-b9ff-3cec35796176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7e87d7e2-5632-4041-b9ff-3cec35796176 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:24.725335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:24.726272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:24.727062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 72/144] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:24.734090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081381-d6e0-47af-848a-7114318d7518 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:24.902160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081381-d6e0-47af-848a-7114318d7518 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:24.931913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:24.947633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c581ec-fdc5-4eae-9290-bfaa7c8eabc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:24.948350 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c581ec-fdc5-4eae-9290-bfaa7c8eabc3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:24.948645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c581ec-fdc5-4eae-9290-bfaa7c8eabc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:24.948926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c581ec-fdc5-4eae-9290-bfaa7c8eabc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:24.949821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c581ec-fdc5-4eae-9290-bfaa7c8eabc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:24.950141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c581ec-fdc5-4eae-9290-bfaa7c8eabc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:24.952231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c581ec-fdc5-4eae-9290-bfaa7c8eabc3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:24.964787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 73/145] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:24.970681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87d7e2-5632-4041-b9ff-3cec35796176 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:25.052196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f8223-13c4-49a3-90b0-29dffaea2eb0 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:25.052502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f8223-13c4-49a3-90b0-29dffaea2eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:25.052777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f8223-13c4-49a3-90b0-29dffaea2eb0 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:25.054154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 74/146] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:25.060170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278875fa-e75c-4963-b8aa-4f46331ad1ca None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:25.061244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278875fa-e75c-4963-b8aa-4f46331ad1ca None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:25.061579 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278875fa-e75c-4963-b8aa-4f46331ad1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:25.097633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-278875fa-e75c-4963-b8aa-4f46331ad1ca None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:25.098925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-278875fa-e75c-4963-b8aa-4f46331ad1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:25.161477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87d7e2-5632-4041-b9ff-3cec35796176 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:25.240508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f5fb-f964-4c87-b654-02e592f14f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:25.241406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f5fb-f964-4c87-b654-02e592f14f45 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:25.241690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f5fb-f964-4c87-b654-02e592f14f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:25.241968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f5fb-f964-4c87-b654-02e592f14f45 None admin] PATH_INFO: `/v3/users/cf26fe88ac274365bfd06ef0c9b8fb89` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:25.243360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707f5fb-f964-4c87-b654-02e592f14f45 None admin] RBAC: Authorizing `identity:get_user(user_id=cf26fe88ac274365bfd06ef0c9b8fb89)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:25.244862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707f5fb-f964-4c87-b654-02e592f14f45 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:25.249125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 73/147] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:24 2022] GET /identity/v3/users/cf26fe88ac274365bfd06ef0c9b8fb89 => generated 289 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:25.257474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 75/148] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:25.258459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f5fb-f964-4c87-b654-02e592f14f45 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:25.268572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:25.355385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278875fa-e75c-4963-b8aa-4f46331ad1ca None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:25.407533 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f5fb-f964-4c87-b654-02e592f14f45 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:25.450432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6510ae-ebbb-49ac-a7d2-0e7155ee9e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:25.452359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6510ae-ebbb-49ac-a7d2-0e7155ee9e19 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:25.452660 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6510ae-ebbb-49ac-a7d2-0e7155ee9e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:25.452955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6510ae-ebbb-49ac-a7d2-0e7155ee9e19 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:25.456403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6510ae-ebbb-49ac-a7d2-0e7155ee9e19 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:25.458554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6510ae-ebbb-49ac-a7d2-0e7155ee9e19 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:25.461183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 74/149] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:25 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:25.467150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6510ae-ebbb-49ac-a7d2-0e7155ee9e19 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:25.578816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:25.606884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6510ae-ebbb-49ac-a7d2-0e7155ee9e19 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:25.661213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278875fa-e75c-4963-b8aa-4f46331ad1ca None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:25.677663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a391a2-d974-48d5-bff5-4efc0f688202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:25.678673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a391a2-d974-48d5-bff5-4efc0f688202 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:25.678975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a391a2-d974-48d5-bff5-4efc0f688202 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:25.679272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a391a2-d974-48d5-bff5-4efc0f688202 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/users/cf26fe88ac274365bfd06ef0c9b8fb89/roles/7050c29529de40c183462f4e9474abcf` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:25.683182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a391a2-d974-48d5-bff5-4efc0f688202 None admin] RBAC: Authorizing `identity:create_grant(project_id=e273488503ac4eb5afd7c77c4bdd34c8, user_id=cf26fe88ac274365bfd06ef0c9b8fb89, role_id=7050c29529de40c183462f4e9474abcf)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:25.684766 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a391a2-d974-48d5-bff5-4efc0f688202 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:25.694392 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:25.720476 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81981e-5c11-4d46-b9e8-2c7602f6047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:25.721256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81981e-5c11-4d46-b9e8-2c7602f6047b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:25.721608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81981e-5c11-4d46-b9e8-2c7602f6047b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:25.721916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81981e-5c11-4d46-b9e8-2c7602f6047b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:25.734564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81981e-5c11-4d46-b9e8-2c7602f6047b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-fb81981e-5c11-4d46-b9e8-2c7602f6047b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:25.743063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:25.743897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:25.744663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:25.745239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 76/150] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:25.750423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81981e-5c11-4d46-b9e8-2c7602f6047b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:25.859414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 75/151] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:16:25 2022] PUT /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/users/cf26fe88ac274365bfd06ef0c9b8fb89/roles/7050c29529de40c183462f4e9474abcf => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:16:25.874020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81981e-5c11-4d46-b9e8-2c7602f6047b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:25.917244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9238e-0dab-4728-900b-09b49aa2731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:25.917992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9238e-0dab-4728-900b-09b49aa2731a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:25.918344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9238e-0dab-4728-900b-09b49aa2731a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:25.918744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9238e-0dab-4728-900b-09b49aa2731a None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:25.919536 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9238e-0dab-4728-900b-09b49aa2731a None admin] RBAC: Adding query filter params (name=member) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:25.920013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9238e-0dab-4728-900b-09b49aa2731a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:25.921995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9238e-0dab-4728-900b-09b49aa2731a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:25.933182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 77/152] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:25.939822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a391a2-d974-48d5-bff5-4efc0f688202 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:26.061185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a391a2-d974-48d5-bff5-4efc0f688202 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:26.100253 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e10e41-88f2-4d87-b820-27f7d574e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:26.101195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e10e41-88f2-4d87-b820-27f7d574e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:26.101491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e10e41-88f2-4d87-b820-27f7d574e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:26.101783 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e10e41-88f2-4d87-b820-27f7d574e5e6 None admin] PATH_INFO: `/v3/users/11c252d8dc954906bdb78f1fc6b107f5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:26.103077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e10e41-88f2-4d87-b820-27f7d574e5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=11c252d8dc954906bdb78f1fc6b107f5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:26.104662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e10e41-88f2-4d87-b820-27f7d574e5e6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:26.106544 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 76/153] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:25 2022] GET /identity/v3/users/11c252d8dc954906bdb78f1fc6b107f5 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:26.112884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9238e-0dab-4728-900b-09b49aa2731a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:26.152952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:26.229588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9238e-0dab-4728-900b-09b49aa2731a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:26.268649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003115a8-4d1b-4259-afc8-027d98de5200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:26.269363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003115a8-4d1b-4259-afc8-027d98de5200 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:26.269711 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003115a8-4d1b-4259-afc8-027d98de5200 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:26.269992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003115a8-4d1b-4259-afc8-027d98de5200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:26.351424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003115a8-4d1b-4259-afc8-027d98de5200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:26.353374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003115a8-4d1b-4259-afc8-027d98de5200 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:26.390280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:26.465716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 78/154] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:16:26.471268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e10e41-88f2-4d87-b820-27f7d574e5e6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:26.478361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:26.615513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e10e41-88f2-4d87-b820-27f7d574e5e6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:26.656393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea8d46-ee4f-4b61-9d74-139e2223a3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:26.657313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8d46-ee4f-4b61-9d74-139e2223a3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:26.657621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8d46-ee4f-4b61-9d74-139e2223a3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:26.657905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8d46-ee4f-4b61-9d74-139e2223a3a5 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:26.664099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea8d46-ee4f-4b61-9d74-139e2223a3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:26.665717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea8d46-ee4f-4b61-9d74-139e2223a3a5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:26.667643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 77/155] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:26 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:26.674969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003115a8-4d1b-4259-afc8-027d98de5200 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:26.789484 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598aae3-650c-4335-b941-0656c9d42bad None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:26.789791 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598aae3-650c-4335-b941-0656c9d42bad None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:26.790065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598aae3-650c-4335-b941-0656c9d42bad None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:26.791597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 78/156] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:26.797801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212f63e-9eec-489d-b63b-a7b6f7f9ee28 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:26.798124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212f63e-9eec-489d-b63b-a7b6f7f9ee28 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:26.798401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212f63e-9eec-489d-b63b-a7b6f7f9ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:26.802015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003115a8-4d1b-4259-afc8-027d98de5200 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:26.831904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5212f63e-9eec-489d-b63b-a7b6f7f9ee28 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:26.836100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5212f63e-9eec-489d-b63b-a7b6f7f9ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:26.861110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4592d7-c083-4bc1-ab80-63174e28b664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:26.861110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4592d7-c083-4bc1-ab80-63174e28b664 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:26.861110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4592d7-c083-4bc1-ab80-63174e28b664 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:26.861110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4592d7-c083-4bc1-ab80-63174e28b664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:26.861500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4592d7-c083-4bc1-ab80-63174e28b664 None admin] RBAC: Adding query filter params (role.id=14542129036041fa85f7c5223487670d, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8, user.id=11c252d8dc954906bdb78f1fc6b107f5) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:26.861856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4592d7-c083-4bc1-ab80-63174e28b664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:26.863544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4592d7-c083-4bc1-ab80-63174e28b664 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:26.865365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:26.870237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 79/157] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:26 2022] GET /identity/v3/role_assignments?user.id=11c252d8dc954906bdb78f1fc6b107f5&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=14542129036041fa85f7c5223487670d => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:26.939609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:26.950875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 79/158] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:27.025732 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4592d7-c083-4bc1-ab80-63174e28b664 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:27.155224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4592d7-c083-4bc1-ab80-63174e28b664 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:27.192173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d44551-9daf-44d6-a1ae-ff18bd4c0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:27.193006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44551-9daf-44d6-a1ae-ff18bd4c0312 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:27.193289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44551-9daf-44d6-a1ae-ff18bd4c0312 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:27.193562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44551-9daf-44d6-a1ae-ff18bd4c0312 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:27.204954 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d44551-9daf-44d6-a1ae-ff18bd4c0312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-43d44551-9daf-44d6-a1ae-ff18bd4c0312 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:27.212980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:27.213822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:27.214672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 80/159] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:27.222460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212f63e-9eec-489d-b63b-a7b6f7f9ee28 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:27.359586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212f63e-9eec-489d-b63b-a7b6f7f9ee28 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:27.399649 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68804-39f0-46a5-ba77-dd290fe93bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:27.400697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68804-39f0-46a5-ba77-dd290fe93bba None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:27.401178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68804-39f0-46a5-ba77-dd290fe93bba None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:27.401719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68804-39f0-46a5-ba77-dd290fe93bba None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:27.402652 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c68804-39f0-46a5-ba77-dd290fe93bba None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:27.403153 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c68804-39f0-46a5-ba77-dd290fe93bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:27.405502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c68804-39f0-46a5-ba77-dd290fe93bba None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:27.416472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 80/160] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:27.422725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d44551-9daf-44d6-a1ae-ff18bd4c0312 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:27.517321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:27.562628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d44551-9daf-44d6-a1ae-ff18bd4c0312 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:27.626025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1c6a5-4be4-4f78-b504-66340464cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:27.626935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1c6a5-4be4-4f78-b504-66340464cc72 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:27.627222 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1c6a5-4be4-4f78-b504-66340464cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:27.627505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1c6a5-4be4-4f78-b504-66340464cc72 None admin] PATH_INFO: `/v3/users/11c252d8dc954906bdb78f1fc6b107f5` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:27.632872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1c6a5-4be4-4f78-b504-66340464cc72 None admin] RBAC: Authorizing `identity:get_user(user_id=11c252d8dc954906bdb78f1fc6b107f5)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:27.634397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1c6a5-4be4-4f78-b504-66340464cc72 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:27.636141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 81/161] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:27 2022] GET /identity/v3/users/11c252d8dc954906bdb78f1fc6b107f5 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:27.642548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68804-39f0-46a5-ba77-dd290fe93bba None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:27.749157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:27.809058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68804-39f0-46a5-ba77-dd290fe93bba None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:27.865707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb31fb-ba7b-4093-ae75-80a7913c5e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:27.866744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb31fb-ba7b-4093-ae75-80a7913c5e3a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:27.867250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb31fb-ba7b-4093-ae75-80a7913c5e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:27.867720 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb31fb-ba7b-4093-ae75-80a7913c5e3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:27.945685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb31fb-ba7b-4093-ae75-80a7913c5e3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:27.947480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb31fb-ba7b-4093-ae75-80a7913c5e3a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:28.011060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:28.052367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 81/162] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:28.058424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1c6a5-4be4-4f78-b504-66340464cc72 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:28.236686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1c6a5-4be4-4f78-b504-66340464cc72 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:28.273074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:28.291753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2e881-37b5-4163-87ad-e5ebd2a8c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:28.292691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2e881-37b5-4163-87ad-e5ebd2a8c69c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:28.292994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2e881-37b5-4163-87ad-e5ebd2a8c69c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:28.293288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2e881-37b5-4163-87ad-e5ebd2a8c69c None admin] PATH_INFO: `/v3/projects/53433a7c21904f8fa62c62a33c9f8eac` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:28.294680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2e881-37b5-4163-87ad-e5ebd2a8c69c None admin] RBAC: Authorizing `identity:get_project(project_id=53433a7c21904f8fa62c62a33c9f8eac)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:28.296320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2e881-37b5-4163-87ad-e5ebd2a8c69c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:28.298140 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 82/163] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:28 2022] GET /identity/v3/projects/53433a7c21904f8fa62c62a33c9f8eac => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:28.305333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb31fb-ba7b-4093-ae75-80a7913c5e3a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:28.428219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb31fb-ba7b-4093-ae75-80a7913c5e3a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:28.471674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d0b22-81fa-4067-8f55-568d38db46b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:28.472750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0b22-81fa-4067-8f55-568d38db46b1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:28.473335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0b22-81fa-4067-8f55-568d38db46b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:28.473804 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0b22-81fa-4067-8f55-568d38db46b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:28.474845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0b22-81fa-4067-8f55-568d38db46b1 None admin] RBAC: Adding query filter params (role.id=14542129036041fa85f7c5223487670d, scope.project.id=53433a7c21904f8fa62c62a33c9f8eac, user.id=11c252d8dc954906bdb78f1fc6b107f5) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:28.475368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0b22-81fa-4067-8f55-568d38db46b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:28.477083 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0b22-81fa-4067-8f55-568d38db46b1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:28.484220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 82/164] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:28 2022] GET /identity/v3/role_assignments?user.id=11c252d8dc954906bdb78f1fc6b107f5&scope.project.id=53433a7c21904f8fa62c62a33c9f8eac&role.id=14542129036041fa85f7c5223487670d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:28.560914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3615-78ab-4be5-bc63-5e0d02540c0e None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:28.561319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3615-78ab-4be5-bc63-5e0d02540c0e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:28.561607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3615-78ab-4be5-bc63-5e0d02540c0e None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:28.562995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 83/165] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:28.575075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b916e1-1384-4fb3-aa57-b700c9457fcb None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:28.576231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b916e1-1384-4fb3-aa57-b700c9457fcb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:28.576837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b916e1-1384-4fb3-aa57-b700c9457fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:28.605293 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c4b916e1-1384-4fb3-aa57-b700c9457fcb None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:28.606877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c4b916e1-1384-4fb3-aa57-b700c9457fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:28.645775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:28.706509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b181a2-7dde-4709-ad5a-24876f640f96 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:28.707532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b181a2-7dde-4709-ad5a-24876f640f96 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:28.708021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b181a2-7dde-4709-ad5a-24876f640f96 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:28.709872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 84/166] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:28.715628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f70a3-f083-4688-b687-eaede365fddf None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:28.716252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f70a3-f083-4688-b687-eaede365fddf None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:28.717009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f70a3-f083-4688-b687-eaede365fddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:28.722733 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 83/167] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:28.745122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-810f70a3-f083-4688-b687-eaede365fddf None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:28.746920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-810f70a3-f083-4688-b687-eaede365fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:28.807179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b916e1-1384-4fb3-aa57-b700c9457fcb None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:28.845785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 85/168] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:28.871383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f70a3-f083-4688-b687-eaede365fddf None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:28.987685 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f70a3-f083-4688-b687-eaede365fddf None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:29.025030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:29.038093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69c9ed-c8ef-4771-b6a4-68ad668483c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:29.039206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69c9ed-c8ef-4771-b6a4-68ad668483c7 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.039651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69c9ed-c8ef-4771-b6a4-68ad668483c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.040175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69c9ed-c8ef-4771-b6a4-68ad668483c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.046993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b916e1-1384-4fb3-aa57-b700c9457fcb None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:29.052414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69c9ed-c8ef-4771-b6a4-68ad668483c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-ec69c9ed-c8ef-4771-b6a4-68ad668483c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:29.062319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:29.063827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:29.064639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:29.067587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 86/169] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:16:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:29.073492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69c9ed-c8ef-4771-b6a4-68ad668483c7 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:29.153028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17592f-0c1d-469a-b1c5-6a75a0c25401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:29.154341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17592f-0c1d-469a-b1c5-6a75a0c25401 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.154619 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17592f-0c1d-469a-b1c5-6a75a0c25401 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.154949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17592f-0c1d-469a-b1c5-6a75a0c25401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.188145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69c9ed-c8ef-4771-b6a4-68ad668483c7 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:29.191469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17592f-0c1d-469a-b1c5-6a75a0c25401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-be17592f-0c1d-469a-b1c5-6a75a0c25401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:29.199391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:29.200332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:29.201249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:29.205048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 84/170] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:29.230803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62852d68-ce93-41aa-832b-8104d5c68ada None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.231088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62852d68-ce93-41aa-832b-8104d5c68ada None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.231373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62852d68-ce93-41aa-832b-8104d5c68ada None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.233140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 85/171] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:29.233870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62852d68-ce93-41aa-832b-8104d5c68ada None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:29.234183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271ab6a-dd19-4f58-92be-54e74982a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:29.235083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271ab6a-dd19-4f58-92be-54e74982a55c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.235588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271ab6a-dd19-4f58-92be-54e74982a55c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.236055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271ab6a-dd19-4f58-92be-54e74982a55c None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.237024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271ab6a-dd19-4f58-92be-54e74982a55c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:29.237504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271ab6a-dd19-4f58-92be-54e74982a55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:29.239127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271ab6a-dd19-4f58-92be-54e74982a55c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:29.249336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 87/172] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:16:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:29.251046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b6bef-4ff0-4bf0-a746-72a7fde67d68 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.251604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b6bef-4ff0-4bf0-a746-72a7fde67d68 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.252059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b6bef-4ff0-4bf0-a746-72a7fde67d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.270448 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-e88b6bef-4ff0-4bf0-a746-72a7fde67d68 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:29.271909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e88b6bef-4ff0-4bf0-a746-72a7fde67d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:29.285880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:29.323502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:29.346441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 88/173] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:29.347543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b6bef-4ff0-4bf0-a746-72a7fde67d68 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:29.457160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62852d68-ce93-41aa-832b-8104d5c68ada None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:29.489997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b6bef-4ff0-4bf0-a746-72a7fde67d68 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:29.519005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cae84b-62b6-42cb-8ea6-7f4559c3bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:29.519793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae84b-62b6-42cb-8ea6-7f4559c3bde2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.520087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae84b-62b6-42cb-8ea6-7f4559c3bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.520366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae84b-62b6-42cb-8ea6-7f4559c3bde2 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.521219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cae84b-62b6-42cb-8ea6-7f4559c3bde2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:29.521526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cae84b-62b6-42cb-8ea6-7f4559c3bde2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:29.523172 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cae84b-62b6-42cb-8ea6-7f4559c3bde2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:29.531543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b86f-79e7-4814-b51d-a028ada57fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:29.532577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b86f-79e7-4814-b51d-a028ada57fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.532925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b86f-79e7-4814-b51d-a028ada57fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.533255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b86f-79e7-4814-b51d-a028ada57fb5 None admin] PATH_INFO: `/v3/users/11c252d8dc954906bdb78f1fc6b107f5` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.534718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9b86f-79e7-4814-b51d-a028ada57fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=11c252d8dc954906bdb78f1fc6b107f5)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:29.536521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9b86f-79e7-4814-b51d-a028ada57fb5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:29.538383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 89/174] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:29 2022] GET /identity/v3/users/11c252d8dc954906bdb78f1fc6b107f5 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:29.539246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b86f-79e7-4814-b51d-a028ada57fb5 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:29.543236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 86/175] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:29.549161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cae84b-62b6-42cb-8ea6-7f4559c3bde2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:29.594660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:29.656460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b86f-79e7-4814-b51d-a028ada57fb5 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:29.693659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:29.695983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea6d6e-0581-44d5-9dcf-22068a58e86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:29.697000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea6d6e-0581-44d5-9dcf-22068a58e86c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.697457 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea6d6e-0581-44d5-9dcf-22068a58e86c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.697907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea6d6e-0581-44d5-9dcf-22068a58e86c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.702605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cae84b-62b6-42cb-8ea6-7f4559c3bde2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:29.709501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea6d6e-0581-44d5-9dcf-22068a58e86c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-70ea6d6e-0581-44d5-9dcf-22068a58e86c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:29.718724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:29.727473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 90/176] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:16:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:29.728507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea6d6e-0581-44d5-9dcf-22068a58e86c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:29.739625 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e27eb-0ed2-478a-ba2b-dfac95f78f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:29.740665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e27eb-0ed2-478a-ba2b-dfac95f78f66 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.741041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e27eb-0ed2-478a-ba2b-dfac95f78f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.741129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e27eb-0ed2-478a-ba2b-dfac95f78f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.820795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e27eb-0ed2-478a-ba2b-dfac95f78f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:29.822321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e27eb-0ed2-478a-ba2b-dfac95f78f66 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:29.849849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea6d6e-0581-44d5-9dcf-22068a58e86c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:29.853183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:29.893220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a8e5b-b354-4dff-a6ae-96e419daeb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:29.894420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a8e5b-b354-4dff-a6ae-96e419daeb4a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.894937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a8e5b-b354-4dff-a6ae-96e419daeb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.895489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a8e5b-b354-4dff-a6ae-96e419daeb4a None admin] PATH_INFO: `/v3/users/a30ed168831044238fab0d0dd5d1bd65` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.897102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a8e5b-b354-4dff-a6ae-96e419daeb4a None admin] RBAC: Authorizing `identity:get_user(user_id=a30ed168831044238fab0d0dd5d1bd65)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:29.899029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a8e5b-b354-4dff-a6ae-96e419daeb4a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:29.906032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 91/177] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:29 2022] GET /identity/v3/users/a30ed168831044238fab0d0dd5d1bd65 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:29.907886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969628eb-ec83-4b2f-8dc9-f0e0df856641 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:29.908351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969628eb-ec83-4b2f-8dc9-f0e0df856641 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:29.908800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969628eb-ec83-4b2f-8dc9-f0e0df856641 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:29.910349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 92/178] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:29.911398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969628eb-ec83-4b2f-8dc9-f0e0df856641 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:29.915022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:29.939558 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 87/179] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:29.940430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e27eb-0ed2-478a-ba2b-dfac95f78f66 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:30.026877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969628eb-ec83-4b2f-8dc9-f0e0df856641 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:30.043213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e27eb-0ed2-478a-ba2b-dfac95f78f66 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:30.063490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a56b8e-851e-4a96-86ea-0731f2f9b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:30.064864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a56b8e-851e-4a96-86ea-0731f2f9b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.065294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a56b8e-851e-4a96-86ea-0731f2f9b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.065705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a56b8e-851e-4a96-86ea-0731f2f9b5c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.066580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a56b8e-851e-4a96-86ea-0731f2f9b5c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:30.067026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a56b8e-851e-4a96-86ea-0731f2f9b5c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:30.068797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a56b8e-851e-4a96-86ea-0731f2f9b5c2 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:30.079352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 93/180] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:30.080775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8565e-adcf-4114-9aae-7665f30dec6d None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.081204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8565e-adcf-4114-9aae-7665f30dec6d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.081622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8565e-adcf-4114-9aae-7665f30dec6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.084085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19191615-f8a7-4c86-b457-c9c679413b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:30.084761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19191615-f8a7-4c86-b457-c9c679413b88 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.085042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19191615-f8a7-4c86-b457-c9c679413b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.085316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19191615-f8a7-4c86-b457-c9c679413b88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.100570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d1d8565e-adcf-4114-9aae-7665f30dec6d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:30.102189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d1d8565e-adcf-4114-9aae-7665f30dec6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:30.130412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:30.135794 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:30.159665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19191615-f8a7-4c86-b457-c9c679413b88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:30.161383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19191615-f8a7-4c86-b457-c9c679413b88 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:30.184218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 94/181] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:30.184218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91c06-23bf-4f62-a67d-1b908e775a12 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.184218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91c06-23bf-4f62-a67d-1b908e775a12 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.184218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91c06-23bf-4f62-a67d-1b908e775a12 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.184218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 95/182] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:30.184218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc91c06-23bf-4f62-a67d-1b908e775a12 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:30.286516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 88/183] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:30.288546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19191615-f8a7-4c86-b457-c9c679413b88 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:30.323069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc91c06-23bf-4f62-a67d-1b908e775a12 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:30.362232 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0908e4-1479-49a5-845f-4f53afe8aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:30.363100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0908e4-1479-49a5-845f-4f53afe8aecb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.363385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0908e4-1479-49a5-845f-4f53afe8aecb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.363663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0908e4-1479-49a5-845f-4f53afe8aecb None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.364877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0908e4-1479-49a5-845f-4f53afe8aecb None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:30.366321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0908e4-1479-49a5-845f-4f53afe8aecb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:30.368036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 96/184] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:30 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:30.369193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c88c-d7e3-4184-9f69-adb69a30f3a5 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.369538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c88c-d7e3-4184-9f69-adb69a30f3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.369820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c88c-d7e3-4184-9f69-adb69a30f3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.378640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:30.387550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-5d22c88c-d7e3-4184-9f69-adb69a30f3a5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:30.389442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5d22c88c-d7e3-4184-9f69-adb69a30f3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:30.401729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19191615-f8a7-4c86-b457-c9c679413b88 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:30.416430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:30.439174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab52be-0fec-45d5-89e2-03d0fa21dd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:30.440132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab52be-0fec-45d5-89e2-03d0fa21dd9a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.440424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab52be-0fec-45d5-89e2-03d0fa21dd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.440711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab52be-0fec-45d5-89e2-03d0fa21dd9a None admin] PATH_INFO: `/v3/users/9e9bfbe698364556bad5de1865527077` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.455161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab52be-0fec-45d5-89e2-03d0fa21dd9a None admin] RBAC: Authorizing `identity:get_user(user_id=9e9bfbe698364556bad5de1865527077)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:30.456744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab52be-0fec-45d5-89e2-03d0fa21dd9a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:30.458986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 89/185] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:30 2022] GET /identity/v3/users/9e9bfbe698364556bad5de1865527077 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:30.459518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab52be-0fec-45d5-89e2-03d0fa21dd9a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:30.468483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 97/186] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:30.469460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22c88c-d7e3-4184-9f69-adb69a30f3a5 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:30.560815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab52be-0fec-45d5-89e2-03d0fa21dd9a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:30.588299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22c88c-d7e3-4184-9f69-adb69a30f3a5 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:30.598875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da603d-5150-4bea-a9a6-c807ff027f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:30.600005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da603d-5150-4bea-a9a6-c807ff027f42 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.600320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da603d-5150-4bea-a9a6-c807ff027f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.600596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da603d-5150-4bea-a9a6-c807ff027f42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.603289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:30.611379 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da603d-5150-4bea-a9a6-c807ff027f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-c8da603d-5150-4bea-a9a6-c807ff027f42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:30.619493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:30.620555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:30.621589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 90/187] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:16:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:30.622401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed175969-52b0-4fdb-be14-3fbfdee5a146 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.622401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed175969-52b0-4fdb-be14-3fbfdee5a146 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.623368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed175969-52b0-4fdb-be14-3fbfdee5a146 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.624647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 91/188] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:30.625372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed175969-52b0-4fdb-be14-3fbfdee5a146 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:30.628728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bf62-7ea4-4013-ac5e-0e8fa965caf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:30.629611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bf62-7ea4-4013-ac5e-0e8fa965caf9 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.629895 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bf62-7ea4-4013-ac5e-0e8fa965caf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.630168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bf62-7ea4-4013-ac5e-0e8fa965caf9 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.631365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129bf62-7ea4-4013-ac5e-0e8fa965caf9 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:30.632854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129bf62-7ea4-4013-ac5e-0e8fa965caf9 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:30.634562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 98/189] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:30 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:30.635318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bf62-7ea4-4013-ac5e-0e8fa965caf9 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:30.667400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:30.740800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bf62-7ea4-4013-ac5e-0e8fa965caf9 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:30.741750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed175969-52b0-4fdb-be14-3fbfdee5a146 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:30.778233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65bbb8-9279-4442-8ad0-dead8b324382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:30.778891 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65bbb8-9279-4442-8ad0-dead8b324382 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.779105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0960470-38ef-4f71-826a-853230fd3ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:30.779265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65bbb8-9279-4442-8ad0-dead8b324382 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.779433 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65bbb8-9279-4442-8ad0-dead8b324382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.779753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960470-38ef-4f71-826a-853230fd3ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.780285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65bbb8-9279-4442-8ad0-dead8b324382 None admin] RBAC: Adding query filter params (role.id=fd4cb9f5c4fb444498c049489198e975, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8, user.id=11c252d8dc954906bdb78f1fc6b107f5) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:30.780658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65bbb8-9279-4442-8ad0-dead8b324382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:30.780742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960470-38ef-4f71-826a-853230fd3ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.781005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960470-38ef-4f71-826a-853230fd3ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.782120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65bbb8-9279-4442-8ad0-dead8b324382 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:30.788120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 92/190] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:30 2022] GET /identity/v3/role_assignments?user.id=11c252d8dc954906bdb78f1fc6b107f5&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=fd4cb9f5c4fb444498c049489198e975 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:30.788917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65bbb8-9279-4442-8ad0-dead8b324382 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:30.864061 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0960470-38ef-4f71-826a-853230fd3ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:30.866585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0960470-38ef-4f71-826a-853230fd3ff6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:30.870663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:30.901999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:30.921474 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65bbb8-9279-4442-8ad0-dead8b324382 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:30.964658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5231a98-8f2f-4c15-9d2b-5aa03c6212f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:30.965572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5231a98-8f2f-4c15-9d2b-5aa03c6212f0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.965897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5231a98-8f2f-4c15-9d2b-5aa03c6212f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.966236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5231a98-8f2f-4c15-9d2b-5aa03c6212f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:30.968031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5231a98-8f2f-4c15-9d2b-5aa03c6212f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:30.970273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5231a98-8f2f-4c15-9d2b-5aa03c6212f0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:30.971951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 93/191] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:30.977052 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5231a98-8f2f-4c15-9d2b-5aa03c6212f0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:30.989131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 99/192] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:30.993482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac688469-26c9-4a1f-88b2-2cd4b743e652 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:30.993767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac688469-26c9-4a1f-88b2-2cd4b743e652 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:30.994049 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac688469-26c9-4a1f-88b2-2cd4b743e652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:31.010999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ac688469-26c9-4a1f-88b2-2cd4b743e652 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:31.012373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ac688469-26c9-4a1f-88b2-2cd4b743e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:31.092061 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 100/193] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:31.092992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac688469-26c9-4a1f-88b2-2cd4b743e652 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:31.098462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5231a98-8f2f-4c15-9d2b-5aa03c6212f0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:31.126479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:31.134280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb6a88-e7a1-4798-be8f-6e20a6a5b2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:31.134980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6a88-e7a1-4798-be8f-6e20a6a5b2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:31.135278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6a88-e7a1-4798-be8f-6e20a6a5b2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:31.135566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6a88-e7a1-4798-be8f-6e20a6a5b2a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:31.136373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb6a88-e7a1-4798-be8f-6e20a6a5b2a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:31.136674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb6a88-e7a1-4798-be8f-6e20a6a5b2a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:31.138828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb6a88-e7a1-4798-be8f-6e20a6a5b2a9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:31.148654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 94/194] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:16:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:31.149529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb6a88-e7a1-4798-be8f-6e20a6a5b2a9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:31.159633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:31.204299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac688469-26c9-4a1f-88b2-2cd4b743e652 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:31.240065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df2519-75e9-4c6e-9b72-9c1a0aecb0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:31.240769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df2519-75e9-4c6e-9b72-9c1a0aecb0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:31.241072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df2519-75e9-4c6e-9b72-9c1a0aecb0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:31.241367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df2519-75e9-4c6e-9b72-9c1a0aecb0e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:31.242209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df2519-75e9-4c6e-9b72-9c1a0aecb0e2 None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8, user.id=a30ed168831044238fab0d0dd5d1bd65) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:31.242734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df2519-75e9-4c6e-9b72-9c1a0aecb0e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:31.244184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df2519-75e9-4c6e-9b72-9c1a0aecb0e2 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:31.250355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 101/195] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:31 2022] GET /identity/v3/role_assignments?user.id=a30ed168831044238fab0d0dd5d1bd65&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:31.251544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df2519-75e9-4c6e-9b72-9c1a0aecb0e2 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:31.251823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb6a88-e7a1-4798-be8f-6e20a6a5b2a9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:31.303121 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046d2d4-7ea1-433c-9b9b-c443c5d26b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:31.304349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046d2d4-7ea1-433c-9b9b-c443c5d26b4f None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:31.304824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046d2d4-7ea1-433c-9b9b-c443c5d26b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:31.305436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046d2d4-7ea1-433c-9b9b-c443c5d26b4f None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:31.307167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046d2d4-7ea1-433c-9b9b-c443c5d26b4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:31.309668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046d2d4-7ea1-433c-9b9b-c443c5d26b4f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:31.379983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df2519-75e9-4c6e-9b72-9c1a0aecb0e2 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:31.407400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:31.419215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33294404-ef67-4a62-b761-e11d7c45abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:31.420717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33294404-ef67-4a62-b761-e11d7c45abdc None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:31.421008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33294404-ef67-4a62-b761-e11d7c45abdc None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:31.421293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33294404-ef67-4a62-b761-e11d7c45abdc None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:31.422517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33294404-ef67-4a62-b761-e11d7c45abdc None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:31.423978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33294404-ef67-4a62-b761-e11d7c45abdc None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:31.425115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 95/196] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:16:31 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:31.431536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046d2d4-7ea1-433c-9b9b-c443c5d26b4f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:31.432942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 102/197] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:31 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:31.433768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33294404-ef67-4a62-b761-e11d7c45abdc None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:31.505608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:31.582388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046d2d4-7ea1-433c-9b9b-c443c5d26b4f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:31.589820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33294404-ef67-4a62-b761-e11d7c45abdc None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:31.631024 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf75e8-bd0b-4697-9757-b923543158bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:31.631786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf75e8-bd0b-4697-9757-b923543158bd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:31.632116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf75e8-bd0b-4697-9757-b923543158bd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:31.632405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf75e8-bd0b-4697-9757-b923543158bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:31.633791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b631b-823d-42fb-9f66-b7dbf9fef0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:31.634964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b631b-823d-42fb-9f66-b7dbf9fef0ea None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:31.635624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b631b-823d-42fb-9f66-b7dbf9fef0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:31.635977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b631b-823d-42fb-9f66-b7dbf9fef0ea None admin] PATH_INFO: `/v3/users/9e9bfbe698364556bad5de1865527077` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:31.640191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b631b-823d-42fb-9f66-b7dbf9fef0ea None admin] RBAC: Authorizing `identity:get_user(user_id=9e9bfbe698364556bad5de1865527077)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:31.640191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b631b-823d-42fb-9f66-b7dbf9fef0ea None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:31.642455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 103/198] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:31 2022] GET /identity/v3/users/9e9bfbe698364556bad5de1865527077 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:31.643210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b631b-823d-42fb-9f66-b7dbf9fef0ea None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:31.647572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf75e8-bd0b-4697-9757-b923543158bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-9ebf75e8-bd0b-4697-9757-b923543158bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:31.656942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:31.657962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:31.658879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 96/199] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:31.659657 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf75e8-bd0b-4697-9757-b923543158bd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:31.724297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:31.779323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b631b-823d-42fb-9f66-b7dbf9fef0ea None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:31.804629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf75e8-bd0b-4697-9757-b923543158bd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:31.816248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:31.828903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314123c4-ac9b-44b3-9e69-3f0f349f418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:31.829607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314123c4-ac9b-44b3-9e69-3f0f349f418c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:31.829918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314123c4-ac9b-44b3-9e69-3f0f349f418c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:31.830187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314123c4-ac9b-44b3-9e69-3f0f349f418c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:31.831082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314123c4-ac9b-44b3-9e69-3f0f349f418c None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1, user.id=9e9bfbe698364556bad5de1865527077) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:31.831413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314123c4-ac9b-44b3-9e69-3f0f349f418c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:31.832969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314123c4-ac9b-44b3-9e69-3f0f349f418c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:31.839434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 104/200] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:31 2022] GET /identity/v3/role_assignments?user.id=9e9bfbe698364556bad5de1865527077&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:31.840329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314123c4-ac9b-44b3-9e69-3f0f349f418c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:31.861157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99249ffc-77e5-425f-84e4-69aa9414e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:31.862288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99249ffc-77e5-425f-84e4-69aa9414e6ab None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:31.862815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99249ffc-77e5-425f-84e4-69aa9414e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:31.863332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99249ffc-77e5-425f-84e4-69aa9414e6ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:31.954324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99249ffc-77e5-425f-84e4-69aa9414e6ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:31.956846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99249ffc-77e5-425f-84e4-69aa9414e6ab None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:31.960285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314123c4-ac9b-44b3-9e69-3f0f349f418c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:31.988951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:32.001826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18738d2-7a92-4f7c-a107-53403af69ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:32.003960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18738d2-7a92-4f7c-a107-53403af69ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:32.003960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18738d2-7a92-4f7c-a107-53403af69ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:32.003960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18738d2-7a92-4f7c-a107-53403af69ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:32.003960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18738d2-7a92-4f7c-a107-53403af69ef6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:32.004303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18738d2-7a92-4f7c-a107-53403af69ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:32.005786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18738d2-7a92-4f7c-a107-53403af69ef6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:32.017719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 105/201] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:32.024325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18738d2-7a92-4f7c-a107-53403af69ef6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:32.157496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 97/202] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:32.169563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99249ffc-77e5-425f-84e4-69aa9414e6ab None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:32.184098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:32.202258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18738d2-7a92-4f7c-a107-53403af69ef6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:32.239884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a7172-1046-4405-bfba-e9af7f46ca1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:32.241057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a7172-1046-4405-bfba-e9af7f46ca1c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:32.241353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a7172-1046-4405-bfba-e9af7f46ca1c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:32.241687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a7172-1046-4405-bfba-e9af7f46ca1c None admin] PATH_INFO: `/v3/users/cf26fe88ac274365bfd06ef0c9b8fb89` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:32.243142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a7172-1046-4405-bfba-e9af7f46ca1c None admin] RBAC: Authorizing `identity:get_user(user_id=cf26fe88ac274365bfd06ef0c9b8fb89)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:32.244743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a7172-1046-4405-bfba-e9af7f46ca1c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:32.246396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 106/203] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:32 2022] GET /identity/v3/users/cf26fe88ac274365bfd06ef0c9b8fb89 => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:32.252433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a7172-1046-4405-bfba-e9af7f46ca1c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:32.313930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:32.364025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a7172-1046-4405-bfba-e9af7f46ca1c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:32.395898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99249ffc-77e5-425f-84e4-69aa9414e6ab None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:32.434152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c198a99-5c47-444f-8b35-3f37662ddf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:32.434827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c198a99-5c47-444f-8b35-3f37662ddf4b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:32.435725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c198a99-5c47-444f-8b35-3f37662ddf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:32.436006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c198a99-5c47-444f-8b35-3f37662ddf4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:32.464831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6821639-e9dc-4784-8f7e-f8174cfb0cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:32.465755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6821639-e9dc-4784-8f7e-f8174cfb0cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:32.466040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6821639-e9dc-4784-8f7e-f8174cfb0cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:32.467043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6821639-e9dc-4784-8f7e-f8174cfb0cd5 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:32.469196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6821639-e9dc-4784-8f7e-f8174cfb0cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:32.470670 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6821639-e9dc-4784-8f7e-f8174cfb0cd5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:32.483068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 98/204] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:32 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:32.484099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6821639-e9dc-4784-8f7e-f8174cfb0cd5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:32.590062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c198a99-5c47-444f-8b35-3f37662ddf4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:32.592108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c198a99-5c47-444f-8b35-3f37662ddf4b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:32.616473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:32.666818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6821639-e9dc-4784-8f7e-f8174cfb0cd5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:32.704448 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:32.739853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc7ffa-16d0-427e-92bf-80977609c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:32.740548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc7ffa-16d0-427e-92bf-80977609c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:32.740828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc7ffa-16d0-427e-92bf-80977609c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:32.744092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc7ffa-16d0-427e-92bf-80977609c3d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:32.744092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc7ffa-16d0-427e-92bf-80977609c3d5 None admin] RBAC: Adding query filter params (role.id=fd4cb9f5c4fb444498c049489198e975, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1, user.id=9e9bfbe698364556bad5de1865527077) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:32.744092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc7ffa-16d0-427e-92bf-80977609c3d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:32.744092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc7ffa-16d0-427e-92bf-80977609c3d5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:32.753690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 99/205] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:32 2022] GET /identity/v3/role_assignments?user.id=9e9bfbe698364556bad5de1865527077&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=fd4cb9f5c4fb444498c049489198e975 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:32.809047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 107/206] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:32.821251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc7ffa-16d0-427e-92bf-80977609c3d5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:33.018257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc7ffa-16d0-427e-92bf-80977609c3d5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:33.060496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a17460-e9ac-4993-862c-676bdc278cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:33.061635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a17460-e9ac-4993-862c-676bdc278cdc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:33.061936 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a17460-e9ac-4993-862c-676bdc278cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:33.062309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a17460-e9ac-4993-862c-676bdc278cdc None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:33.063786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a17460-e9ac-4993-862c-676bdc278cdc None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:33.065744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a17460-e9ac-4993-862c-676bdc278cdc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:33.068280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 100/207] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:32 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:33.074038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c198a99-5c47-444f-8b35-3f37662ddf4b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:33.200985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c198a99-5c47-444f-8b35-3f37662ddf4b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:33.240848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dc30e-1709-4d90-8ec2-91c09fcbf331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:33.241603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc30e-1709-4d90-8ec2-91c09fcbf331 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:33.241922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc30e-1709-4d90-8ec2-91c09fcbf331 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:33.242257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc30e-1709-4d90-8ec2-91c09fcbf331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:33.243174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dc30e-1709-4d90-8ec2-91c09fcbf331 None admin] RBAC: Adding query filter params (role.id=7050c29529de40c183462f4e9474abcf, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8, user.id=cf26fe88ac274365bfd06ef0c9b8fb89) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:33.243527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dc30e-1709-4d90-8ec2-91c09fcbf331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:33.245188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dc30e-1709-4d90-8ec2-91c09fcbf331 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:33.253624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 108/208] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:33 2022] GET /identity/v3/role_assignments?user.id=cf26fe88ac274365bfd06ef0c9b8fb89&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=7050c29529de40c183462f4e9474abcf => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:34.202813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5d93e-eea8-4ca8-a4b4-4f9b13cb35f5 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:34.203329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5d93e-eea8-4ca8-a4b4-4f9b13cb35f5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:34.203435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5d93e-eea8-4ca8-a4b4-4f9b13cb35f5 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:34.204958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 101/209] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:34.210581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370aa33-ab16-4aed-9c6b-8699cf299d89 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:34.211083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370aa33-ab16-4aed-9c6b-8699cf299d89 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:34.211596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370aa33-ab16-4aed-9c6b-8699cf299d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:34.234745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-e370aa33-ab16-4aed-9c6b-8699cf299d89 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:34.236645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e370aa33-ab16-4aed-9c6b-8699cf299d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:34.260820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:34.312708 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1bad0-3129-442d-8e3d-a72529e6b5d7 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:34.313341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1bad0-3129-442d-8e3d-a72529e6b5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:34.313840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1bad0-3129-442d-8e3d-a72529e6b5d7 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:34.315391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 102/210] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:34.322510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6667f-72a2-4b8e-97d6-1eef30f80072 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:34.323061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6667f-72a2-4b8e-97d6-1eef30f80072 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:34.323796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6667f-72a2-4b8e-97d6-1eef30f80072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:34.333116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 109/211] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:34.337654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:34.345460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2cc6667f-72a2-4b8e-97d6-1eef30f80072 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:34.346926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2cc6667f-72a2-4b8e-97d6-1eef30f80072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:34.368339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370aa33-ab16-4aed-9c6b-8699cf299d89 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:34.433981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 103/212] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:34.461438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6667f-72a2-4b8e-97d6-1eef30f80072 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:34.500125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370aa33-ab16-4aed-9c6b-8699cf299d89 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:34.561242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91a8f-9cd3-4302-bbf4-874a0080498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:34.562249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91a8f-9cd3-4302-bbf4-874a0080498f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:34.562609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91a8f-9cd3-4302-bbf4-874a0080498f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:34.562957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91a8f-9cd3-4302-bbf4-874a0080498f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:34.564629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91a8f-9cd3-4302-bbf4-874a0080498f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:34.567345 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91a8f-9cd3-4302-bbf4-874a0080498f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:34.576050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 110/213] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:34.578018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91a8f-9cd3-4302-bbf4-874a0080498f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:34.604421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:34.617242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6667f-72a2-4b8e-97d6-1eef30f80072 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:34.663622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ff036-3814-490e-8e8d-8ced35e272bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:34.664779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff036-3814-490e-8e8d-8ced35e272bc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:34.665263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff036-3814-490e-8e8d-8ced35e272bc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:34.665718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff036-3814-490e-8e8d-8ced35e272bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:34.669793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:34.680142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ff036-3814-490e-8e8d-8ced35e272bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-bf0ff036-3814-490e-8e8d-8ced35e272bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:34.690119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:34.691062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 104/214] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:34.698334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bc792-3dfe-40a0-bb14-14090b00f728 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:34.699066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bc792-3dfe-40a0-bb14-14090b00f728 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:34.699066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bc792-3dfe-40a0-bb14-14090b00f728 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:34.699066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 105/215] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:34.699066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bc792-3dfe-40a0-bb14-14090b00f728 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:34.708737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91a8f-9cd3-4302-bbf4-874a0080498f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:34.752346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824a8c1-8f80-4000-9bad-2f92210e8189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:34.752986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824a8c1-8f80-4000-9bad-2f92210e8189 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:34.753294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824a8c1-8f80-4000-9bad-2f92210e8189 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:34.754036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824a8c1-8f80-4000-9bad-2f92210e8189 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:34.754531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824a8c1-8f80-4000-9bad-2f92210e8189 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:34.756019 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824a8c1-8f80-4000-9bad-2f92210e8189 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:34.826845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bc792-3dfe-40a0-bb14-14090b00f728 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:34.865209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86976d53-b270-4d33-bd23-cb1db7d27621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:34.865959 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86976d53-b270-4d33-bd23-cb1db7d27621 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:34.866269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86976d53-b270-4d33-bd23-cb1db7d27621 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:34.866534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86976d53-b270-4d33-bd23-cb1db7d27621 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:34.867282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86976d53-b270-4d33-bd23-cb1db7d27621 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:34.867610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86976d53-b270-4d33-bd23-cb1db7d27621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:34.869213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86976d53-b270-4d33-bd23-cb1db7d27621 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:34.883726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 111/216] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:16:34 2022] POST /identity/v3/users => generated 297 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:34.883726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf56066-49e2-44a2-b970-ae7d806d0eb8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:34.883726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf56066-49e2-44a2-b970-ae7d806d0eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:34.883726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf56066-49e2-44a2-b970-ae7d806d0eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:34.893729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 106/217] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:34.903211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86976d53-b270-4d33-bd23-cb1db7d27621 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:34.910120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-eaf56066-49e2-44a2-b970-ae7d806d0eb8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:34.912212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-eaf56066-49e2-44a2-b970-ae7d806d0eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:34.993634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:35.014775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 112/218] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:35.041060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf56066-49e2-44a2-b970-ae7d806d0eb8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:35.043709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:35.052266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86976d53-b270-4d33-bd23-cb1db7d27621 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:35.095637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906b968-53b6-4b28-b50f-df72621778ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:35.096728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906b968-53b6-4b28-b50f-df72621778ab None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:35.097080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906b968-53b6-4b28-b50f-df72621778ab None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:35.097424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906b968-53b6-4b28-b50f-df72621778ab None admin] PATH_INFO: `/v3/users/296ec89c183c407b849ce44516ae2de8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:35.115547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906b968-53b6-4b28-b50f-df72621778ab None admin] RBAC: Authorizing `identity:get_user(user_id=296ec89c183c407b849ce44516ae2de8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:35.117476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906b968-53b6-4b28-b50f-df72621778ab None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:35.120191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 107/219] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:34 2022] GET /identity/v3/users/296ec89c183c407b849ce44516ae2de8 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:35.127466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906b968-53b6-4b28-b50f-df72621778ab None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:35.165616 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf56066-49e2-44a2-b970-ae7d806d0eb8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:35.211619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5204b-e653-4c75-b825-1565cb15b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:35.213971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5204b-e653-4c75-b825-1565cb15b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:35.216942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5204b-e653-4c75-b825-1565cb15b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:35.217394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5204b-e653-4c75-b825-1565cb15b1e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:35.239985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5204b-e653-4c75-b825-1565cb15b1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b4c5204b-e653-4c75-b825-1565cb15b1e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:35.249830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:35.251565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:35.253258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 113/220] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:16:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:35.261523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5204b-e653-4c75-b825-1565cb15b1e3 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:35.297130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906b968-53b6-4b28-b50f-df72621778ab None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:35.324933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:35.354542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82968c8e-4fe9-4bc7-89dc-579c397eb263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:35.355517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968c8e-4fe9-4bc7-89dc-579c397eb263 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:35.355819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968c8e-4fe9-4bc7-89dc-579c397eb263 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:35.356234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968c8e-4fe9-4bc7-89dc-579c397eb263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:35.386803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:35.443986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5204b-e653-4c75-b825-1565cb15b1e3 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:35.457928 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82968c8e-4fe9-4bc7-89dc-579c397eb263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:35.460179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82968c8e-4fe9-4bc7-89dc-579c397eb263 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:35.483640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e33f0-1e33-42f0-a4b5-babb9892ccf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:35.484357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e33f0-1e33-42f0-a4b5-babb9892ccf1 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:35.484646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e33f0-1e33-42f0-a4b5-babb9892ccf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:35.484928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e33f0-1e33-42f0-a4b5-babb9892ccf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:35.485689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e33f0-1e33-42f0-a4b5-babb9892ccf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:35.486001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e33f0-1e33-42f0-a4b5-babb9892ccf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:35.487516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e33f0-1e33-42f0-a4b5-babb9892ccf1 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:35.497155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 114/221] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:35.499346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8af048-d563-4029-9a71-f9746e8862e3 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:35.499647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8af048-d563-4029-9a71-f9746e8862e3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:35.499952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8af048-d563-4029-9a71-f9746e8862e3 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:35.501273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 115/222] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:35.506262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8af048-d563-4029-9a71-f9746e8862e3 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:35.585880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 108/223] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:35.585880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca8a7-e349-4d15-969e-c4d291a3c3a1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:35.585880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca8a7-e349-4d15-969e-c4d291a3c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:35.585880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca8a7-e349-4d15-969e-c4d291a3c3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:35.601513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-797ca8a7-e349-4d15-969e-c4d291a3c3a1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:35.602823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-797ca8a7-e349-4d15-969e-c4d291a3c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:35.615228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:35.634230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8af048-d563-4029-9a71-f9746e8862e3 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:35.663704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:35.678866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 109/224] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:35.679723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ca8a7-e349-4d15-969e-c4d291a3c3a1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:35.683137 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bc999-4adc-4319-995d-197a9a492a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:35.684025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bc999-4adc-4319-995d-197a9a492a81 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:35.684369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bc999-4adc-4319-995d-197a9a492a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:35.684644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bc999-4adc-4319-995d-197a9a492a81 None admin] PATH_INFO: `/v3/users/9e9bfbe698364556bad5de1865527077` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:35.687365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bc999-4adc-4319-995d-197a9a492a81 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9bfbe698364556bad5de1865527077)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:35.688877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bc999-4adc-4319-995d-197a9a492a81 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:35.690810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 116/225] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:35 2022] GET /identity/v3/users/9e9bfbe698364556bad5de1865527077 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:35.700873 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bc999-4adc-4319-995d-197a9a492a81 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:35.811252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ca8a7-e349-4d15-969e-c4d291a3c3a1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:35.845243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bc999-4adc-4319-995d-197a9a492a81 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:35.854629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3fc32-c003-4ef3-bcac-f155af2611dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:35.855872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fc32-c003-4ef3-bcac-f155af2611dd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:35.856405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fc32-c003-4ef3-bcac-f155af2611dd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:35.856882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fc32-c003-4ef3-bcac-f155af2611dd None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:35.858405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3fc32-c003-4ef3-bcac-f155af2611dd None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:35.860276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3fc32-c003-4ef3-bcac-f155af2611dd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:35.862744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 110/226] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:35 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:35.863712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3fc32-c003-4ef3-bcac-f155af2611dd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:35.885081 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:35.897219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4848c0-7355-4c53-ad27-7f49c899c625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:35.898104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4848c0-7355-4c53-ad27-7f49c899c625 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:35.898543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4848c0-7355-4c53-ad27-7f49c899c625 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:35.898827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4848c0-7355-4c53-ad27-7f49c899c625 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:35.900670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4848c0-7355-4c53-ad27-7f49c899c625 None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:35.902312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4848c0-7355-4c53-ad27-7f49c899c625 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:35.906106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 117/227] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:35 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:35.929351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4848c0-7355-4c53-ad27-7f49c899c625 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:35.986339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:35.998958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3fc32-c003-4ef3-bcac-f155af2611dd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:36.040135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4848c0-7355-4c53-ad27-7f49c899c625 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:36.041415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8faf3f-410f-4a57-a3bc-5af0a87da250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:36.042404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8faf3f-410f-4a57-a3bc-5af0a87da250 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:36.042684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8faf3f-410f-4a57-a3bc-5af0a87da250 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:36.042958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8faf3f-410f-4a57-a3bc-5af0a87da250 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:36.056011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8faf3f-410f-4a57-a3bc-5af0a87da250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5b8faf3f-410f-4a57-a3bc-5af0a87da250 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:36.066312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:36.068409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 111/228] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:16:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:36.069458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8faf3f-410f-4a57-a3bc-5af0a87da250 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:36.083492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93c8a8-c13c-4464-8d51-afdc2f79cbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:36.084548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93c8a8-c13c-4464-8d51-afdc2f79cbfa None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:36.084990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93c8a8-c13c-4464-8d51-afdc2f79cbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:36.085402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93c8a8-c13c-4464-8d51-afdc2f79cbfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:36.086526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93c8a8-c13c-4464-8d51-afdc2f79cbfa None admin] RBAC: Adding query filter params (role.id=14542129036041fa85f7c5223487670d, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1, user.id=296ec89c183c407b849ce44516ae2de8) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:36.087100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93c8a8-c13c-4464-8d51-afdc2f79cbfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:36.089034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93c8a8-c13c-4464-8d51-afdc2f79cbfa None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:36.096580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 118/229] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:35 2022] GET /identity/v3/role_assignments?user.id=296ec89c183c407b849ce44516ae2de8&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=14542129036041fa85f7c5223487670d => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:36.097475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93c8a8-c13c-4464-8d51-afdc2f79cbfa None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:36.200844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:36.268613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8faf3f-410f-4a57-a3bc-5af0a87da250 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:36.313045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a270d1-075c-484c-aedf-7fd26ac9600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:36.314065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a270d1-075c-484c-aedf-7fd26ac9600b None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:36.314425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a270d1-075c-484c-aedf-7fd26ac9600b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:36.314751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a270d1-075c-484c-aedf-7fd26ac9600b None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/users/9e9bfbe698364556bad5de1865527077/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:36.316469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93c8a8-c13c-4464-8d51-afdc2f79cbfa None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:36.320321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a270d1-075c-484c-aedf-7fd26ac9600b None admin] RBAC: Authorizing `identity:create_grant(project_id=7eded0dcb0364e7ba479f0adbfff2ff1, user_id=9e9bfbe698364556bad5de1865527077, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:36.321793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a270d1-075c-484c-aedf-7fd26ac9600b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:36.342099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:36.355182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445dfe6-a8ec-455a-bbee-12682aedf808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:36.355802 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445dfe6-a8ec-455a-bbee-12682aedf808 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:36.356179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445dfe6-a8ec-455a-bbee-12682aedf808 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:36.356470 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445dfe6-a8ec-455a-bbee-12682aedf808 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:36.358616 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445dfe6-a8ec-455a-bbee-12682aedf808 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:36.358938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445dfe6-a8ec-455a-bbee-12682aedf808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:36.360712 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445dfe6-a8ec-455a-bbee-12682aedf808 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:36.371922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 119/230] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:16:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:36.379656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445dfe6-a8ec-455a-bbee-12682aedf808 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:36.403231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 112/231] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:16:36 2022] PUT /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/users/9e9bfbe698364556bad5de1865527077/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:16:36.510440 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445dfe6-a8ec-455a-bbee-12682aedf808 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:36.554763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ece4c0-87b8-41fb-8c1b-5c7965e31d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:36.555734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ece4c0-87b8-41fb-8c1b-5c7965e31d31 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:36.556023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ece4c0-87b8-41fb-8c1b-5c7965e31d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:36.556330 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ece4c0-87b8-41fb-8c1b-5c7965e31d31 None admin] PATH_INFO: `/v3/users/9e9bfbe698364556bad5de1865527077` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:36.557632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ece4c0-87b8-41fb-8c1b-5c7965e31d31 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9bfbe698364556bad5de1865527077)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:36.559090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ece4c0-87b8-41fb-8c1b-5c7965e31d31 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:36.566151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 120/232] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:36 2022] GET /identity/v3/users/9e9bfbe698364556bad5de1865527077 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:36.567506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a270d1-075c-484c-aedf-7fd26ac9600b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:36.719187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a270d1-075c-484c-aedf-7fd26ac9600b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:36.757233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01f648-a499-4f57-8faa-378d2ae086e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:36.758111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01f648-a499-4f57-8faa-378d2ae086e8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:36.758397 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01f648-a499-4f57-8faa-378d2ae086e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:36.758679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01f648-a499-4f57-8faa-378d2ae086e8 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:36.759859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01f648-a499-4f57-8faa-378d2ae086e8 None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:36.761357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01f648-a499-4f57-8faa-378d2ae086e8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:36.763633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 113/233] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:36 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:36.771684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ece4c0-87b8-41fb-8c1b-5c7965e31d31 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:36.839208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:36.898938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ece4c0-87b8-41fb-8c1b-5c7965e31d31 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:36.937007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d20aac-09ce-4ea3-85cf-964590a313b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:36.937904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d20aac-09ce-4ea3-85cf-964590a313b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:36.938191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d20aac-09ce-4ea3-85cf-964590a313b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:36.938469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d20aac-09ce-4ea3-85cf-964590a313b7 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/users/9e9bfbe698364556bad5de1865527077/roles/fd4cb9f5c4fb444498c049489198e975` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:36.940839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d20aac-09ce-4ea3-85cf-964590a313b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eded0dcb0364e7ba479f0adbfff2ff1, user_id=9e9bfbe698364556bad5de1865527077, role_id=fd4cb9f5c4fb444498c049489198e975)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:36.942504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d20aac-09ce-4ea3-85cf-964590a313b7 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:37.058484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 121/234] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:16:36 2022] PUT /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/users/9e9bfbe698364556bad5de1865527077/roles/fd4cb9f5c4fb444498c049489198e975 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:16:37.562712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f83494-6932-4dfc-ae8b-98fdb96e164f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:37.563278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f83494-6932-4dfc-ae8b-98fdb96e164f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:37.563278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f83494-6932-4dfc-ae8b-98fdb96e164f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:37.564669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 114/235] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:37.570455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf77edc-9782-415f-8b19-91aee5de676b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:37.570893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf77edc-9782-415f-8b19-91aee5de676b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:37.571004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf77edc-9782-415f-8b19-91aee5de676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:37.597385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-acf77edc-9782-415f-8b19-91aee5de676b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:37.598689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-acf77edc-9782-415f-8b19-91aee5de676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:37.678556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396971df-7daf-48e3-a644-9f5edaa2994c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:37.678880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396971df-7daf-48e3-a644-9f5edaa2994c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:37.679118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396971df-7daf-48e3-a644-9f5edaa2994c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:37.682682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 115/236] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:37.689079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c6ce-1f52-4e5e-a77c-4b556d999787 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:37.689357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c6ce-1f52-4e5e-a77c-4b556d999787 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:37.689641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c6ce-1f52-4e5e-a77c-4b556d999787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:37.698851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:37.718607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9a20c6ce-1f52-4e5e-a77c-4b556d999787 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:37.720092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9a20c6ce-1f52-4e5e-a77c-4b556d999787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:37.748092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 122/237] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:37.773845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf77edc-9782-415f-8b19-91aee5de676b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:37.842290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 116/238] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:37.851951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:37.887248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20c6ce-1f52-4e5e-a77c-4b556d999787 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:37.994279 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf77edc-9782-415f-8b19-91aee5de676b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:38.036727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b61e5-8146-4145-ab11-bde5152732d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:38.037542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b61e5-8146-4145-ab11-bde5152732d3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:38.037829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b61e5-8146-4145-ab11-bde5152732d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:38.038141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b61e5-8146-4145-ab11-bde5152732d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:38.067165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b61e5-8146-4145-ab11-bde5152732d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-ac7b61e5-8146-4145-ab11-bde5152732d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:38.083020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:38.083900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:38.084704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:38.085816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 123/239] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:38.093269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b61e5-8146-4145-ab11-bde5152732d3 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:38.167892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20c6ce-1f52-4e5e-a77c-4b556d999787 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:38.222010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:38.228141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8da103-0029-437e-8ae1-5a1efea0b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:38.229716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da103-0029-437e-8ae1-5a1efea0b0ee None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:38.232018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da103-0029-437e-8ae1-5a1efea0b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:38.232605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da103-0029-437e-8ae1-5a1efea0b0ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:38.235559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8da103-0029-437e-8ae1-5a1efea0b0ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:38.241917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8da103-0029-437e-8ae1-5a1efea0b0ee None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:38.241917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 117/240] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:38.249079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8da103-0029-437e-8ae1-5a1efea0b0ee None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:38.274013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b61e5-8146-4145-ab11-bde5152732d3 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:38.281705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:38.349034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf71e18-d5b8-4ede-878b-387130ab9fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:38.349877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf71e18-d5b8-4ede-878b-387130ab9fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:38.350198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf71e18-d5b8-4ede-878b-387130ab9fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:38.350516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf71e18-d5b8-4ede-878b-387130ab9fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:38.351531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf71e18-d5b8-4ede-878b-387130ab9fd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:38.351893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf71e18-d5b8-4ede-878b-387130ab9fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:38.353604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf71e18-d5b8-4ede-878b-387130ab9fd6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:38.369217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 124/241] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:38.377010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf71e18-d5b8-4ede-878b-387130ab9fd6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:38.459464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8da103-0029-437e-8ae1-5a1efea0b0ee None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:38.518017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecd370-3eaa-454a-a02d-665aeefbf072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:38.521509 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd370-3eaa-454a-a02d-665aeefbf072 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:38.522009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd370-3eaa-454a-a02d-665aeefbf072 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:38.523458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd370-3eaa-454a-a02d-665aeefbf072 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:38.524442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecd370-3eaa-454a-a02d-665aeefbf072 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:38.528829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecd370-3eaa-454a-a02d-665aeefbf072 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:38.568912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf71e18-d5b8-4ede-878b-387130ab9fd6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:38.607720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd23bc-dfcf-4a9e-a665-b91a776a5586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:38.609516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd23bc-dfcf-4a9e-a665-b91a776a5586 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:38.610002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd23bc-dfcf-4a9e-a665-b91a776a5586 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:38.610452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd23bc-dfcf-4a9e-a665-b91a776a5586 None admin] PATH_INFO: `/v3/users/70cd912f6ee647a3a8b4187320ae338a` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:38.628493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd23bc-dfcf-4a9e-a665-b91a776a5586 None admin] RBAC: Authorizing `identity:get_user(user_id=70cd912f6ee647a3a8b4187320ae338a)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:38.630426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd23bc-dfcf-4a9e-a665-b91a776a5586 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:38.632598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 125/242] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:38 2022] GET /identity/v3/users/70cd912f6ee647a3a8b4187320ae338a => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:38.639549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd23bc-dfcf-4a9e-a665-b91a776a5586 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:38.666801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:38.690841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 118/243] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:16:38 2022] POST /identity/v3/users => generated 293 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:38.703089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b265a3-2902-463f-bb14-a6d8ef1f6ca3 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:38.703393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b265a3-2902-463f-bb14-a6d8ef1f6ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:38.703691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b265a3-2902-463f-bb14-a6d8ef1f6ca3 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:38.705858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 119/244] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:38.711699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c92b10-0d7c-4d4d-afda-9854a46db42d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:38.711990 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c92b10-0d7c-4d4d-afda-9854a46db42d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:38.712316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c92b10-0d7c-4d4d-afda-9854a46db42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:38.733119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c8c92b10-0d7c-4d4d-afda-9854a46db42d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:38.734399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c8c92b10-0d7c-4d4d-afda-9854a46db42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:38.773836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd23bc-dfcf-4a9e-a665-b91a776a5586 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:38.818760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0cd26-903d-4f26-aa24-aab16e004fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:38.819729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:38.821124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0cd26-903d-4f26-aa24-aab16e004fda None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:38.821615 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0cd26-903d-4f26-aa24-aab16e004fda None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:38.822072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0cd26-903d-4f26-aa24-aab16e004fda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:38.884885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 120/245] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:38.908406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0cd26-903d-4f26-aa24-aab16e004fda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:38.910212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0cd26-903d-4f26-aa24-aab16e004fda None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:38.925380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c92b10-0d7c-4d4d-afda-9854a46db42d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:38.944469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:39.063178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 126/246] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:39.069443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0cd26-903d-4f26-aa24-aab16e004fda None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:39.115988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c92b10-0d7c-4d4d-afda-9854a46db42d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:39.160150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdc61f-edfc-4b17-828f-49510bad8a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:39.161050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc61f-edfc-4b17-828f-49510bad8a54 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:39.161413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc61f-edfc-4b17-828f-49510bad8a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:39.161682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc61f-edfc-4b17-828f-49510bad8a54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:39.177461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdc61f-edfc-4b17-828f-49510bad8a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-40bdc61f-edfc-4b17-828f-49510bad8a54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:39.190133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:39.191063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:39.191921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 121/247] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:39.202299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdc61f-edfc-4b17-828f-49510bad8a54 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:39.230226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0cd26-903d-4f26-aa24-aab16e004fda None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:39.261977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:39.275260 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:39.300483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed019366-3d67-41a7-b424-62cf2387f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:39.300483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed019366-3d67-41a7-b424-62cf2387f51e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:39.300483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed019366-3d67-41a7-b424-62cf2387f51e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:39.300483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed019366-3d67-41a7-b424-62cf2387f51e None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:39.300804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed019366-3d67-41a7-b424-62cf2387f51e None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:39.300804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed019366-3d67-41a7-b424-62cf2387f51e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:39.300804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 127/248] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:39 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:39.304589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed019366-3d67-41a7-b424-62cf2387f51e None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:39.342149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdc61f-edfc-4b17-828f-49510bad8a54 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:39.386737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dabe0-2423-418c-9ffa-31a685a57500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:39.387422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dabe0-2423-418c-9ffa-31a685a57500 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:39.388292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dabe0-2423-418c-9ffa-31a685a57500 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:39.388752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dabe0-2423-418c-9ffa-31a685a57500 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:39.390169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dabe0-2423-418c-9ffa-31a685a57500 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:39.391032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dabe0-2423-418c-9ffa-31a685a57500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:39.393288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dabe0-2423-418c-9ffa-31a685a57500 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:39.404930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 122/249] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:39.409990 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dabe0-2423-418c-9ffa-31a685a57500 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:39.452878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed019366-3d67-41a7-b424-62cf2387f51e None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:39.532217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dabe0-2423-418c-9ffa-31a685a57500 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:39.544612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:39.552855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d8ee3-8edd-4b5c-88d8-03bde4e136b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:39.553549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d8ee3-8edd-4b5c-88d8-03bde4e136b9 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:39.553840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d8ee3-8edd-4b5c-88d8-03bde4e136b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:39.554123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d8ee3-8edd-4b5c-88d8-03bde4e136b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:39.555214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d8ee3-8edd-4b5c-88d8-03bde4e136b9 None admin] RBAC: Adding query filter params (role.id=7050c29529de40c183462f4e9474abcf, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1, user.id=70cd912f6ee647a3a8b4187320ae338a) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:39.555321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d8ee3-8edd-4b5c-88d8-03bde4e136b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:39.556880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d8ee3-8edd-4b5c-88d8-03bde4e136b9 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:39.572584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 128/250] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:39 2022] GET /identity/v3/role_assignments?user.id=70cd912f6ee647a3a8b4187320ae338a&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=7050c29529de40c183462f4e9474abcf => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:39.584699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806cc45-3747-46ea-a1f9-168fa2586d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:39.585887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806cc45-3747-46ea-a1f9-168fa2586d97 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:39.586342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806cc45-3747-46ea-a1f9-168fa2586d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:39.586764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806cc45-3747-46ea-a1f9-168fa2586d97 None admin] PATH_INFO: `/v3/users/296ec89c183c407b849ce44516ae2de8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:39.588350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806cc45-3747-46ea-a1f9-168fa2586d97 None admin] RBAC: Authorizing `identity:get_user(user_id=296ec89c183c407b849ce44516ae2de8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:39.590325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806cc45-3747-46ea-a1f9-168fa2586d97 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:39.593350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 123/251] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:39 2022] GET /identity/v3/users/296ec89c183c407b849ce44516ae2de8 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:39.598624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d8ee3-8edd-4b5c-88d8-03bde4e136b9 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:39.707266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:39.752365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e540a-45cb-4cc1-86da-d2d8adc9c2b9 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:39.753506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e540a-45cb-4cc1-86da-d2d8adc9c2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:39.753988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e540a-45cb-4cc1-86da-d2d8adc9c2b9 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:39.757109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 124/252] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:39.763512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e83d80-51f2-4772-9b2c-8b9a61e88c1c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:39.764309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e83d80-51f2-4772-9b2c-8b9a61e88c1c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:39.765107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e83d80-51f2-4772-9b2c-8b9a61e88c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:39.774453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d8ee3-8edd-4b5c-88d8-03bde4e136b9 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:39.796170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-76e83d80-51f2-4772-9b2c-8b9a61e88c1c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:39.798320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-76e83d80-51f2-4772-9b2c-8b9a61e88c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:39.874248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ac3e9-7fa7-4594-8545-0a1f7950dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:39.875161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ac3e9-7fa7-4594-8545-0a1f7950dabe None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:39.875448 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ac3e9-7fa7-4594-8545-0a1f7950dabe None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:39.875723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ac3e9-7fa7-4594-8545-0a1f7950dabe None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:39.877028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ac3e9-7fa7-4594-8545-0a1f7950dabe None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:39.878494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ac3e9-7fa7-4594-8545-0a1f7950dabe None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:39.888787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 129/253] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:39 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:39.897563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ac3e9-7fa7-4594-8545-0a1f7950dabe None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:39.901838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 125/254] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:39.942607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e83d80-51f2-4772-9b2c-8b9a61e88c1c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:40.116872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e83d80-51f2-4772-9b2c-8b9a61e88c1c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:40.122748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ac3e9-7fa7-4594-8545-0a1f7950dabe None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:40.138789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:40.172651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:40.186564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81117fbc-4699-457d-8c26-f4a49c144af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:40.187463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81117fbc-4699-457d-8c26-f4a49c144af1 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:40.187737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81117fbc-4699-457d-8c26-f4a49c144af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:40.188009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81117fbc-4699-457d-8c26-f4a49c144af1 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/users/296ec89c183c407b849ce44516ae2de8/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:40.190074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81117fbc-4699-457d-8c26-f4a49c144af1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eded0dcb0364e7ba479f0adbfff2ff1, user_id=296ec89c183c407b849ce44516ae2de8, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:40.191544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81117fbc-4699-457d-8c26-f4a49c144af1 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:40.221995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601a861-baa0-43eb-9e4b-5913d2057cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:40.222809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601a861-baa0-43eb-9e4b-5913d2057cab None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:40.223159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601a861-baa0-43eb-9e4b-5913d2057cab None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:40.223432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601a861-baa0-43eb-9e4b-5913d2057cab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:40.238256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601a861-baa0-43eb-9e4b-5913d2057cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2601a861-baa0-43eb-9e4b-5913d2057cab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:40.245978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:40.246861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:40.248361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 126/255] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:40.249497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6038083-88a7-40b2-80ee-3f4d0d133abd None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:40.250541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6038083-88a7-40b2-80ee-3f4d0d133abd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:40.250541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6038083-88a7-40b2-80ee-3f4d0d133abd None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:40.251622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 127/256] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:40.256171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6038083-88a7-40b2-80ee-3f4d0d133abd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:40.304782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 130/257] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:16:39 2022] PUT /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/users/296ec89c183c407b849ce44516ae2de8/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:16:40.307064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c84f1-99d3-4dd6-9e29-577f27624892 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:40.307353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c84f1-99d3-4dd6-9e29-577f27624892 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:40.307632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c84f1-99d3-4dd6-9e29-577f27624892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:40.339514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-448c84f1-99d3-4dd6-9e29-577f27624892 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:40.343013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-448c84f1-99d3-4dd6-9e29-577f27624892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:40.473847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6038083-88a7-40b2-80ee-3f4d0d133abd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:40.497644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 131/258] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:40.537918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146c9cf-dd71-4e94-8641-afc75103ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:40.538617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c9cf-dd71-4e94-8641-afc75103ee65 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:40.538898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c9cf-dd71-4e94-8641-afc75103ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:40.539169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c9cf-dd71-4e94-8641-afc75103ee65 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:40.539925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146c9cf-dd71-4e94-8641-afc75103ee65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:40.540255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146c9cf-dd71-4e94-8641-afc75103ee65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:40.541684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146c9cf-dd71-4e94-8641-afc75103ee65 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:40.545764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c84f1-99d3-4dd6-9e29-577f27624892 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:40.557405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 128/259] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:40.564279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146c9cf-dd71-4e94-8641-afc75103ee65 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:40.628268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:40.714732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146c9cf-dd71-4e94-8641-afc75103ee65 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:40.723752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c84f1-99d3-4dd6-9e29-577f27624892 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:40.741573 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:40.774160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a04bf-4ef2-4f11-a773-45f19be306db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:40.774994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a04bf-4ef2-4f11-a773-45f19be306db None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:40.775281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a04bf-4ef2-4f11-a773-45f19be306db None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:40.775559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a04bf-4ef2-4f11-a773-45f19be306db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:40.790232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c1f64-c037-4994-aaa5-08ae9fe8e275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:40.791130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c1f64-c037-4994-aaa5-08ae9fe8e275 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:40.791407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c1f64-c037-4994-aaa5-08ae9fe8e275 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:40.791679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c1f64-c037-4994-aaa5-08ae9fe8e275 None admin] PATH_INFO: `/v3/users/9e9bfbe698364556bad5de1865527077` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:40.792930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c1f64-c037-4994-aaa5-08ae9fe8e275 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9bfbe698364556bad5de1865527077)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:40.795138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c1f64-c037-4994-aaa5-08ae9fe8e275 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:40.796923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 129/260] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:40 2022] GET /identity/v3/users/9e9bfbe698364556bad5de1865527077 => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:40.802431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a04bf-4ef2-4f11-a773-45f19be306db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:40.802590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c1f64-c037-4994-aaa5-08ae9fe8e275 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-416a04bf-4ef2-4f11-a773-45f19be306db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:40.810750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:40.811627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:40.812561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:40.816430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 132/261] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:16:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:40.821042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a04bf-4ef2-4f11-a773-45f19be306db None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:41.026981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a04bf-4ef2-4f11-a773-45f19be306db None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:41.060464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:41.070212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c1f64-c037-4994-aaa5-08ae9fe8e275 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:41.120953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a1cca-2dd1-4bb2-93a8-cd7fbb5989a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:41.121647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a1cca-2dd1-4bb2-93a8-cd7fbb5989a4 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:41.121932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a1cca-2dd1-4bb2-93a8-cd7fbb5989a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:41.122837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a1cca-2dd1-4bb2-93a8-cd7fbb5989a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:41.123831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a1cca-2dd1-4bb2-93a8-cd7fbb5989a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:41.124184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a1cca-2dd1-4bb2-93a8-cd7fbb5989a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:41.125590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a1cca-2dd1-4bb2-93a8-cd7fbb5989a4 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:41.130338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482d108-1034-4bfc-8d3d-492c53a6af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:41.130995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d108-1034-4bfc-8d3d-492c53a6af6d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:41.131274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d108-1034-4bfc-8d3d-492c53a6af6d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:41.131549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d108-1034-4bfc-8d3d-492c53a6af6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:41.143700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 133/262] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:16:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:41.148996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a1cca-2dd1-4bb2-93a8-cd7fbb5989a4 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:41.251272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:41.283859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482d108-1034-4bfc-8d3d-492c53a6af6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:41.285622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482d108-1034-4bfc-8d3d-492c53a6af6d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:41.423363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a1cca-2dd1-4bb2-93a8-cd7fbb5989a4 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:41.476469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:41.484481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 130/263] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:16:41.490170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482d108-1034-4bfc-8d3d-492c53a6af6d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:41.521289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083ac4-e43b-412a-b312-235550eb3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:41.522204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083ac4-e43b-412a-b312-235550eb3d53 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:41.522489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083ac4-e43b-412a-b312-235550eb3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:41.522766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083ac4-e43b-412a-b312-235550eb3d53 None admin] PATH_INFO: `/v3/users/9e9bfbe698364556bad5de1865527077` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:41.529105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083ac4-e43b-412a-b312-235550eb3d53 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9bfbe698364556bad5de1865527077)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:41.530588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083ac4-e43b-412a-b312-235550eb3d53 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:41.532301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 134/264] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:41 2022] GET /identity/v3/users/9e9bfbe698364556bad5de1865527077 => generated 283 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:41.537587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083ac4-e43b-412a-b312-235550eb3d53 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:41.647513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482d108-1034-4bfc-8d3d-492c53a6af6d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:41.685174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3655-e4b8-4ee6-8115-4c8988511dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:41.686196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3655-e4b8-4ee6-8115-4c8988511dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:41.686579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3655-e4b8-4ee6-8115-4c8988511dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:41.686976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3655-e4b8-4ee6-8115-4c8988511dc2 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:41.688416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a3655-e4b8-4ee6-8115-4c8988511dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:41.690154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a3655-e4b8-4ee6-8115-4c8988511dc2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:41.692255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 131/265] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:41 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:41.698227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3655-e4b8-4ee6-8115-4c8988511dc2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:41.766843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:41.800065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083ac4-e43b-412a-b312-235550eb3d53 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:41.807407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3655-e4b8-4ee6-8115-4c8988511dc2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:41.808992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:41.845971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5f6eb-15ea-440f-8aac-9176278ed415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:41.847164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5f6eb-15ea-440f-8aac-9176278ed415 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:41.847676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5f6eb-15ea-440f-8aac-9176278ed415 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:41.848197 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5f6eb-15ea-440f-8aac-9176278ed415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:41.849321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5f6eb-15ea-440f-8aac-9176278ed415 None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1, user.id=9e9bfbe698364556bad5de1865527077) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:41.849836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5f6eb-15ea-440f-8aac-9176278ed415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:41.851485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5f6eb-15ea-440f-8aac-9176278ed415 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:41.859341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 132/266] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:41 2022] GET /identity/v3/role_assignments?user.id=9e9bfbe698364556bad5de1865527077&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:41.867118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0083587-bdb6-467b-92e0-be2483ba8bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:41.867794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0083587-bdb6-467b-92e0-be2483ba8bdb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:41.868094 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0083587-bdb6-467b-92e0-be2483ba8bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:41.868376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0083587-bdb6-467b-92e0-be2483ba8bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:41.988003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0083587-bdb6-467b-92e0-be2483ba8bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:41.989507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0083587-bdb6-467b-92e0-be2483ba8bdb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:42.143014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 135/267] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:16:42.148338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5f6eb-15ea-440f-8aac-9176278ed415 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:42.270966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5f6eb-15ea-440f-8aac-9176278ed415 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:42.310118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:42.317036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef3fac-07ea-43ce-848c-501c84e6bfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:42.317884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef3fac-07ea-43ce-848c-501c84e6bfae None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:42.318476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef3fac-07ea-43ce-848c-501c84e6bfae None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:42.318759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef3fac-07ea-43ce-848c-501c84e6bfae None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:42.321785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef3fac-07ea-43ce-848c-501c84e6bfae None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:42.322915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef3fac-07ea-43ce-848c-501c84e6bfae None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:42.324995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 133/268] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:42 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:42.331298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0083587-bdb6-467b-92e0-be2483ba8bdb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:42.334466 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:42.375089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5f68e-dc18-43fc-9a9c-b8d85682b1b3 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:42.375441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5f68e-dc18-43fc-9a9c-b8d85682b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:42.375789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5f68e-dc18-43fc-9a9c-b8d85682b1b3 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:42.377423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 134/269] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:42.386526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99eba-b887-4c32-81d3-16cb437363f1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:42.386810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99eba-b887-4c32-81d3-16cb437363f1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:42.387091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99eba-b887-4c32-81d3-16cb437363f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:42.414031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d0f99eba-b887-4c32-81d3-16cb437363f1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:42.416110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d0f99eba-b887-4c32-81d3-16cb437363f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:42.514414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0083587-bdb6-467b-92e0-be2483ba8bdb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:42.534800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 135/270] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:42.536208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a61e07-f9db-4bed-9d97-ceecec97f49f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:42.536500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a61e07-f9db-4bed-9d97-ceecec97f49f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:42.536778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a61e07-f9db-4bed-9d97-ceecec97f49f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:42.538046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 136/271] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:42.539106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa6eae-a1d3-482b-b15b-4357fc0a5cc6 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:42.539588 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa6eae-a1d3-482b-b15b-4357fc0a5cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:42.539875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa6eae-a1d3-482b-b15b-4357fc0a5cc6 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:42.541323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 137/272] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:42.546077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac492-ce6d-41ef-b885-7af2895f9dfc None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:42.546365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac492-ce6d-41ef-b885-7af2895f9dfc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:42.546644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac492-ce6d-41ef-b885-7af2895f9dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:42.562999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771cc47-67a1-4ecb-99f5-e1ae08ccfb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:42.563673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771cc47-67a1-4ecb-99f5-e1ae08ccfb18 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:42.563958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771cc47-67a1-4ecb-99f5-e1ae08ccfb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:42.564264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771cc47-67a1-4ecb-99f5-e1ae08ccfb18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:42.565167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771cc47-67a1-4ecb-99f5-e1ae08ccfb18 None admin] RBAC: Adding query filter params (role.id=fd4cb9f5c4fb444498c049489198e975, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1, user.id=9e9bfbe698364556bad5de1865527077) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:42.565487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771cc47-67a1-4ecb-99f5-e1ae08ccfb18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:42.565593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-278ac492-ce6d-41ef-b885-7af2895f9dfc None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:42.566795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-278ac492-ce6d-41ef-b885-7af2895f9dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:42.566957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771cc47-67a1-4ecb-99f5-e1ae08ccfb18 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:42.576923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 136/273] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:42 2022] GET /identity/v3/role_assignments?user.id=9e9bfbe698364556bad5de1865527077&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=fd4cb9f5c4fb444498c049489198e975 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:42.578081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9962a-ccf6-459a-a309-775819ac7cac None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:42.578371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9962a-ccf6-459a-a309-775819ac7cac None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:42.578652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9962a-ccf6-459a-a309-775819ac7cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:42.601081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ddd9962a-ccf6-459a-a309-775819ac7cac None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:42.602404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ddd9962a-ccf6-459a-a309-775819ac7cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:42.671983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 138/274] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:42.674032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ac492-ce6d-41ef-b885-7af2895f9dfc None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:42.695770 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:42.702581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 137/275] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:42.708259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9962a-ccf6-459a-a309-775819ac7cac None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:42.775975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:42.830354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ac492-ce6d-41ef-b885-7af2895f9dfc None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:42.857024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9962a-ccf6-459a-a309-775819ac7cac None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:42.873960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cad1c-a551-44c0-9984-a29a5142d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:42.874771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cad1c-a551-44c0-9984-a29a5142d486 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:42.875095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cad1c-a551-44c0-9984-a29a5142d486 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:42.875361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cad1c-a551-44c0-9984-a29a5142d486 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:42.876586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cad1c-a551-44c0-9984-a29a5142d486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:42.877948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cad1c-a551-44c0-9984-a29a5142d486 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:42.879717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 139/276] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:42.881505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cad1c-a551-44c0-9984-a29a5142d486 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:42.897652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad2c97-7236-4a40-8662-611c068420d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:42.898458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad2c97-7236-4a40-8662-611c068420d8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:42.898741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad2c97-7236-4a40-8662-611c068420d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:42.899021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad2c97-7236-4a40-8662-611c068420d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:42.911023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad2c97-7236-4a40-8662-611c068420d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-e4ad2c97-7236-4a40-8662-611c068420d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:42.919699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:42.920640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:42.921841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 138/277] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:42.926562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad2c97-7236-4a40-8662-611c068420d8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:42.986539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cad1c-a551-44c0-9984-a29a5142d486 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:42.990201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:43.013948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:43.026561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5e4c-ea84-4589-bcce-b7c1ce10724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:43.027362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5e4c-ea84-4589-bcce-b7c1ce10724f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.027672 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5e4c-ea84-4589-bcce-b7c1ce10724f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.027922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5e4c-ea84-4589-bcce-b7c1ce10724f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.035980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad2c97-7236-4a40-8662-611c068420d8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:43.038141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d5e4c-ea84-4589-bcce-b7c1ce10724f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-088d5e4c-ea84-4589-bcce-b7c1ce10724f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:43.046694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:43.047838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:43.048858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:43.052688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 140/278] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:43.053502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5e4c-ea84-4589-bcce-b7c1ce10724f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:43.082837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab543f-d391-49b5-adf3-fa7c364dedcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:43.083517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab543f-d391-49b5-adf3-fa7c364dedcb None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.083819 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab543f-d391-49b5-adf3-fa7c364dedcb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.084103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab543f-d391-49b5-adf3-fa7c364dedcb None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.084847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab543f-d391-49b5-adf3-fa7c364dedcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:43.086295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab543f-d391-49b5-adf3-fa7c364dedcb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:43.159227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5e4c-ea84-4589-bcce-b7c1ce10724f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:43.199007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab415f-b343-45e7-ac19-e48b3f5df02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:43.199706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab415f-b343-45e7-ac19-e48b3f5df02a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.200031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab415f-b343-45e7-ac19-e48b3f5df02a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.200924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab415f-b343-45e7-ac19-e48b3f5df02a None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.201737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 139/279] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:16:42 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:43.210668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab415f-b343-45e7-ac19-e48b3f5df02a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:43.210668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab415f-b343-45e7-ac19-e48b3f5df02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:43.210846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab543f-d391-49b5-adf3-fa7c364dedcb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:43.210915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab415f-b343-45e7-ac19-e48b3f5df02a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:43.214168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 141/280] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:43.220474 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab415f-b343-45e7-ac19-e48b3f5df02a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:43.279899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:43.329437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab543f-d391-49b5-adf3-fa7c364dedcb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:43.342163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab415f-b343-45e7-ac19-e48b3f5df02a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:43.345065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:43.368810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670344-9688-4757-aa46-35bf8fa14f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:43.369800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670344-9688-4757-aa46-35bf8fa14f6a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.370238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670344-9688-4757-aa46-35bf8fa14f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.370659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670344-9688-4757-aa46-35bf8fa14f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.371421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5670344-9688-4757-aa46-35bf8fa14f6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:43.371729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5670344-9688-4757-aa46-35bf8fa14f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:43.374057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5670344-9688-4757-aa46-35bf8fa14f6a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:43.384278 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 140/281] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:43.385336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fee00-784d-41df-b849-d9f15e45ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:43.385922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e27a-2cd0-4945-8b85-4dbb34be376c None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.386211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e27a-2cd0-4945-8b85-4dbb34be376c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.386322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fee00-784d-41df-b849-d9f15e45ace9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.386489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e27a-2cd0-4945-8b85-4dbb34be376c None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.386580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fee00-784d-41df-b849-d9f15e45ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.386759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fee00-784d-41df-b849-d9f15e45ace9 None admin] PATH_INFO: `/v3/users/70cd912f6ee647a3a8b4187320ae338a` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.388358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fee00-784d-41df-b849-d9f15e45ace9 None admin] RBAC: Authorizing `identity:get_user(user_id=70cd912f6ee647a3a8b4187320ae338a)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:43.389839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fee00-784d-41df-b849-d9f15e45ace9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:43.391836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 142/282] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:43 2022] GET /identity/v3/users/70cd912f6ee647a3a8b4187320ae338a => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:43.392238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 141/283] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:43.396094 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fee00-784d-41df-b849-d9f15e45ace9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:43.396217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3feed4-2dfd-4a2a-a9bb-fcf83fbd6e7f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.396217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3feed4-2dfd-4a2a-a9bb-fcf83fbd6e7f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.396217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3feed4-2dfd-4a2a-a9bb-fcf83fbd6e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.411892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-0c3feed4-2dfd-4a2a-a9bb-fcf83fbd6e7f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:43.413141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0c3feed4-2dfd-4a2a-a9bb-fcf83fbd6e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:43.491957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 142/284] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:43.497628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3feed4-2dfd-4a2a-a9bb-fcf83fbd6e7f None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:43.511084 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fee00-784d-41df-b849-d9f15e45ace9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:43.531228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:43.556747 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd926a-8ecb-4836-9865-4268b6415691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:43.557646 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd926a-8ecb-4836-9865-4268b6415691 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.557936 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd926a-8ecb-4836-9865-4268b6415691 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.558218 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd926a-8ecb-4836-9865-4268b6415691 None admin] PATH_INFO: `/v3/users/eed34424149f45adb3c532fed7bd63d4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.576792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd926a-8ecb-4836-9865-4268b6415691 None admin] RBAC: Authorizing `identity:get_user(user_id=eed34424149f45adb3c532fed7bd63d4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:43.578855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd926a-8ecb-4836-9865-4268b6415691 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:43.585088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 143/285] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:43 2022] GET /identity/v3/users/eed34424149f45adb3c532fed7bd63d4 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:43.585088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd926a-8ecb-4836-9865-4268b6415691 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:43.636001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3feed4-2dfd-4a2a-a9bb-fcf83fbd6e7f None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:43.647647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:43.676382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57883925-0643-4b9a-a2f9-812edc1ec6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:43.677675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883925-0643-4b9a-a2f9-812edc1ec6df None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.678250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883925-0643-4b9a-a2f9-812edc1ec6df None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.678863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883925-0643-4b9a-a2f9-812edc1ec6df None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.680568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57883925-0643-4b9a-a2f9-812edc1ec6df None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:43.682259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57883925-0643-4b9a-a2f9-812edc1ec6df None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:43.685253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 143/286] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:43 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:43.686406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57883925-0643-4b9a-a2f9-812edc1ec6df None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:43.716750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd926a-8ecb-4836-9865-4268b6415691 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:43.761178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960ec57-66a3-4e15-a697-ee0693796b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:43.762652 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960ec57-66a3-4e15-a697-ee0693796b8d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.763257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960ec57-66a3-4e15-a697-ee0693796b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.763748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960ec57-66a3-4e15-a697-ee0693796b8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.779021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960ec57-66a3-4e15-a697-ee0693796b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7960ec57-66a3-4e15-a697-ee0693796b8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:43.790452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:43.791357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:43.792223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:43.793475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 144/287] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:43.799168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960ec57-66a3-4e15-a697-ee0693796b8d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:43.811952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57883925-0643-4b9a-a2f9-812edc1ec6df None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:43.859830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a662e-6618-43aa-b6ac-b07de2541dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:43.860717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a662e-6618-43aa-b6ac-b07de2541dee None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:43.861023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a662e-6618-43aa-b6ac-b07de2541dee None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:43.861305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a662e-6618-43aa-b6ac-b07de2541dee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:43.862302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a662e-6618-43aa-b6ac-b07de2541dee None admin] RBAC: Adding query filter params (role.id=14542129036041fa85f7c5223487670d, user.id=eed34424149f45adb3c532fed7bd63d4, scope.system=all) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:43.862645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a662e-6618-43aa-b6ac-b07de2541dee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:43.864419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a662e-6618-43aa-b6ac-b07de2541dee None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:43.867342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:43.880380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 144/288] 10.222.0.77 () {56 vars in 1308 bytes} [Thu Jun 16 17:16:43 2022] GET /identity/v3/role_assignments?user.id=eed34424149f45adb3c532fed7bd63d4&scope.system=all&role.id=14542129036041fa85f7c5223487670d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:43.881393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a662e-6618-43aa-b6ac-b07de2541dee None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:43.946366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960ec57-66a3-4e15-a697-ee0693796b8d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:43.947566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:44.020449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec48c8-5c1b-421e-9c60-4aab32e40b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:44.021749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec48c8-5c1b-421e-9c60-4aab32e40b50 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:44.022246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec48c8-5c1b-421e-9c60-4aab32e40b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:44.022713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec48c8-5c1b-421e-9c60-4aab32e40b50 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/users/70cd912f6ee647a3a8b4187320ae338a/roles/7050c29529de40c183462f4e9474abcf` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:44.025394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec48c8-5c1b-421e-9c60-4aab32e40b50 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eded0dcb0364e7ba479f0adbfff2ff1, user_id=70cd912f6ee647a3a8b4187320ae338a, role_id=7050c29529de40c183462f4e9474abcf)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:44.027164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec48c8-5c1b-421e-9c60-4aab32e40b50 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:44.048150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a662e-6618-43aa-b6ac-b07de2541dee None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:44.087170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38bfc-8703-470b-803f-bdffda3d7f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:44.088200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38bfc-8703-470b-803f-bdffda3d7f08 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:44.088644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38bfc-8703-470b-803f-bdffda3d7f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:44.089079 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38bfc-8703-470b-803f-bdffda3d7f08 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:44.090081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f38bfc-8703-470b-803f-bdffda3d7f08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:44.090546 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f38bfc-8703-470b-803f-bdffda3d7f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:44.092211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f38bfc-8703-470b-803f-bdffda3d7f08 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:44.101366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 145/289] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:44.109163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38bfc-8703-470b-803f-bdffda3d7f08 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:44.131389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 145/290] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:16:43 2022] PUT /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/users/70cd912f6ee647a3a8b4187320ae338a/roles/7050c29529de40c183462f4e9474abcf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:16:44.252041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:44.259553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38bfc-8703-470b-803f-bdffda3d7f08 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:44.308621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be792ad-795b-4c40-8fab-6ae68e582c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:44.309535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be792ad-795b-4c40-8fab-6ae68e582c98 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:44.309810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be792ad-795b-4c40-8fab-6ae68e582c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:44.310086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be792ad-795b-4c40-8fab-6ae68e582c98 None admin] PATH_INFO: `/v3/users/296ec89c183c407b849ce44516ae2de8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:44.311378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be792ad-795b-4c40-8fab-6ae68e582c98 None admin] RBAC: Authorizing `identity:get_user(user_id=296ec89c183c407b849ce44516ae2de8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:44.312879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be792ad-795b-4c40-8fab-6ae68e582c98 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:44.315058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 146/291] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:44 2022] GET /identity/v3/users/296ec89c183c407b849ce44516ae2de8 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:44.320734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec48c8-5c1b-421e-9c60-4aab32e40b50 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:44.442032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:44.451484 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec48c8-5c1b-421e-9c60-4aab32e40b50 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:44.486837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13379837-b745-44cf-8a0f-9ffb8909fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:44.487809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13379837-b745-44cf-8a0f-9ffb8909fec6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:44.488194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13379837-b745-44cf-8a0f-9ffb8909fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:44.488676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13379837-b745-44cf-8a0f-9ffb8909fec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:44.560303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13379837-b745-44cf-8a0f-9ffb8909fec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:44.561677 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13379837-b745-44cf-8a0f-9ffb8909fec6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:44.657366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:44.666863 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 146/292] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:44.672667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be792ad-795b-4c40-8fab-6ae68e582c98 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:44.812694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be792ad-795b-4c40-8fab-6ae68e582c98 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:44.855663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa9adb-68f3-4d4f-8189-b194639b3ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:44.857305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa9adb-68f3-4d4f-8189-b194639b3ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:44.857811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa9adb-68f3-4d4f-8189-b194639b3ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:44.857935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa9adb-68f3-4d4f-8189-b194639b3ab4 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:44.859070 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa9adb-68f3-4d4f-8189-b194639b3ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:44.860547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa9adb-68f3-4d4f-8189-b194639b3ab4 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:44.862441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 147/293] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:44 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:44.873219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13379837-b745-44cf-8a0f-9ffb8909fec6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:44.995109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13379837-b745-44cf-8a0f-9ffb8909fec6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:45.032195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c04cd6-32c0-49c1-a764-d4ba71e2e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:45.032867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04cd6-32c0-49c1-a764-d4ba71e2e192 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:45.033149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04cd6-32c0-49c1-a764-d4ba71e2e192 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:45.033427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04cd6-32c0-49c1-a764-d4ba71e2e192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:45.034251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c04cd6-32c0-49c1-a764-d4ba71e2e192 None admin] RBAC: Adding query filter params (role.id=14542129036041fa85f7c5223487670d, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1, user.id=296ec89c183c407b849ce44516ae2de8) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:45.034568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c04cd6-32c0-49c1-a764-d4ba71e2e192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:45.036004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c04cd6-32c0-49c1-a764-d4ba71e2e192 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:45.042484 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 147/294] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:44 2022] GET /identity/v3/role_assignments?user.id=296ec89c183c407b849ce44516ae2de8&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=14542129036041fa85f7c5223487670d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:45.844306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6a04-b79c-4bf4-89ca-bea86bde7cf3 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:45.844537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6a04-b79c-4bf4-89ca-bea86bde7cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:45.844841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6a04-b79c-4bf4-89ca-bea86bde7cf3 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:45.846174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 148/295] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:45.851435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb1042-22b6-44d0-bd57-2729114aff7d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:45.851732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb1042-22b6-44d0-bd57-2729114aff7d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:45.852013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb1042-22b6-44d0-bd57-2729114aff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:45.869581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-86fb1042-22b6-44d0-bd57-2729114aff7d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:45.870784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-86fb1042-22b6-44d0-bd57-2729114aff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:45.882004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51556740-5463-4e83-b9ae-2c9116b0e51e None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:45.882953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51556740-5463-4e83-b9ae-2c9116b0e51e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:45.883349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51556740-5463-4e83-b9ae-2c9116b0e51e None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:45.889215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 149/296] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:45.890963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19619f3-e95c-46c6-b706-9cc3ddbff5f8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:45.891249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19619f3-e95c-46c6-b706-9cc3ddbff5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:45.891525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19619f3-e95c-46c6-b706-9cc3ddbff5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:45.913464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-b19619f3-e95c-46c6-b706-9cc3ddbff5f8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:45.914642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b19619f3-e95c-46c6-b706-9cc3ddbff5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:45.948879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:45.957746 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:45.978144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 148/297] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:45.991566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 150/298] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:46.003712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb1042-22b6-44d0-bd57-2729114aff7d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:46.015900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19619f3-e95c-46c6-b706-9cc3ddbff5f8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:46.118904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19619f3-e95c-46c6-b706-9cc3ddbff5f8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:46.123842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb1042-22b6-44d0-bd57-2729114aff7d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:46.157229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef141f1d-bd9f-4fd6-945a-c0499fbfc111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:46.158076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef141f1d-bd9f-4fd6-945a-c0499fbfc111 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.158360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef141f1d-bd9f-4fd6-945a-c0499fbfc111 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.158732 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef141f1d-bd9f-4fd6-945a-c0499fbfc111 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.169900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef141f1d-bd9f-4fd6-945a-c0499fbfc111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:46.172429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a521deb-eae0-4e13-843f-4d0e0d625ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:46.173478 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a521deb-eae0-4e13-843f-4d0e0d625ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.173970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a521deb-eae0-4e13-843f-4d0e0d625ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.174469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a521deb-eae0-4e13-843f-4d0e0d625ec6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.175843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a521deb-eae0-4e13-843f-4d0e0d625ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:46.177553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a521deb-eae0-4e13-843f-4d0e0d625ec6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-ef141f1d-bd9f-4fd6-945a-c0499fbfc111 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:46.178106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:46.179031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:46.179832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 151/299] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:46.181444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 149/300] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:46.187768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef141f1d-bd9f-4fd6-945a-c0499fbfc111 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:46.189033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a521deb-eae0-4e13-843f-4d0e0d625ec6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:46.217222 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:46.255430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:46.293466 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef141f1d-bd9f-4fd6-945a-c0499fbfc111 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:46.311817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a521deb-eae0-4e13-843f-4d0e0d625ec6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:46.329610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd837f1-651c-4a79-b26e-d4e3e9f5f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:46.330304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd837f1-651c-4a79-b26e-d4e3e9f5f297 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.330840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd837f1-651c-4a79-b26e-d4e3e9f5f297 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.330840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd837f1-651c-4a79-b26e-d4e3e9f5f297 None admin] PATH_INFO: `/v3/groups` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.331522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd837f1-651c-4a79-b26e-d4e3e9f5f297 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:46.333013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd837f1-651c-4a79-b26e-d4e3e9f5f297 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:46.353498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5238-9518-4ba4-a58a-7110125cb560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:46.354324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5238-9518-4ba4-a58a-7110125cb560 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.354677 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5238-9518-4ba4-a58a-7110125cb560 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.355022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5238-9518-4ba4-a58a-7110125cb560 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.355845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5238-9518-4ba4-a58a-7110125cb560 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:46.357777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5238-9518-4ba4-a58a-7110125cb560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:46.359862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5238-9518-4ba4-a58a-7110125cb560 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:46.373744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 150/301] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:46.375140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5238-9518-4ba4-a58a-7110125cb560 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:46.470965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 152/302] 10.222.0.77 () {60 vars in 1134 bytes} [Thu Jun 16 17:16:46 2022] POST /identity/v3/groups => generated 229 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:16:46.472137 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4095-e32f-4041-b25f-2f695b2a6920 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.472435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4095-e32f-4041-b25f-2f695b2a6920 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.472976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4095-e32f-4041-b25f-2f695b2a6920 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.474126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 153/303] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:46.479664 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12417d-1e92-4752-8873-01523e560aad None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.480004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12417d-1e92-4752-8873-01523e560aad None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.480270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12417d-1e92-4752-8873-01523e560aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.499282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-0f12417d-1e92-4752-8873-01523e560aad None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:46.503861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0f12417d-1e92-4752-8873-01523e560aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:46.507669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5238-9518-4ba4-a58a-7110125cb560 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:46.531999 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:46.564402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e4c42-6f91-4a42-acab-1884f6f09dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:46.565728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e4c42-6f91-4a42-acab-1884f6f09dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.566225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e4c42-6f91-4a42-acab-1884f6f09dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.566981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e4c42-6f91-4a42-acab-1884f6f09dd1 None admin] PATH_INFO: `/v3/users/e1f2ed52038040a98dc3ce466264a2c9` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.584750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e4c42-6f91-4a42-acab-1884f6f09dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=e1f2ed52038040a98dc3ce466264a2c9)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:46.586418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e4c42-6f91-4a42-acab-1884f6f09dd1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:46.588631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 151/304] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:46 2022] GET /identity/v3/users/e1f2ed52038040a98dc3ce466264a2c9 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:46.595026 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e4c42-6f91-4a42-acab-1884f6f09dd1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:46.600358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 154/305] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:46.623017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12417d-1e92-4752-8873-01523e560aad None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:46.647224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:46.741282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e4c42-6f91-4a42-acab-1884f6f09dd1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:46.762983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12417d-1e92-4752-8873-01523e560aad None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:46.779470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ba856-7391-4cb6-ab84-eb4cecc94b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:46.780195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ba856-7391-4cb6-ab84-eb4cecc94b62 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.780480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ba856-7391-4cb6-ab84-eb4cecc94b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.780749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ba856-7391-4cb6-ab84-eb4cecc94b62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.781563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ba856-7391-4cb6-ab84-eb4cecc94b62 None admin] RBAC: Adding query filter params (role.id=7050c29529de40c183462f4e9474abcf, user.id=e1f2ed52038040a98dc3ce466264a2c9, scope.system=all) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:46.781875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ba856-7391-4cb6-ab84-eb4cecc94b62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:46.783308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ba856-7391-4cb6-ab84-eb4cecc94b62 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:46.789210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 152/306] 10.222.0.77 () {56 vars in 1308 bytes} [Thu Jun 16 17:16:46 2022] GET /identity/v3/role_assignments?user.id=e1f2ed52038040a98dc3ce466264a2c9&scope.system=all&role.id=7050c29529de40c183462f4e9474abcf => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:46.790271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99723e7a-488b-4f3e-ad1f-95f55f254cc8 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.790561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99723e7a-488b-4f3e-ad1f-95f55f254cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.790841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99723e7a-488b-4f3e-ad1f-95f55f254cc8 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.792294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 153/307] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:46.798222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa77da1-2376-428b-a2af-011f6f537c67 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.798511 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa77da1-2376-428b-a2af-011f6f537c67 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.798793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa77da1-2376-428b-a2af-011f6f537c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.810104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98307ff8-3a79-4c19-ad1e-4bee4016aa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:46.812154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307ff8-3a79-4c19-ad1e-4bee4016aa22 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:46.812673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307ff8-3a79-4c19-ad1e-4bee4016aa22 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:46.813124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307ff8-3a79-4c19-ad1e-4bee4016aa22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:46.818343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5fa77da1-2376-428b-a2af-011f6f537c67 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:46.819674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5fa77da1-2376-428b-a2af-011f6f537c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:46.829294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98307ff8-3a79-4c19-ad1e-4bee4016aa22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-98307ff8-3a79-4c19-ad1e-4bee4016aa22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:46.841097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:46.842313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:46.843143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 155/308] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:46.849480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98307ff8-3a79-4c19-ad1e-4bee4016aa22 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:46.862800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:46.917011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 154/309] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:46.941245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa77da1-2376-428b-a2af-011f6f537c67 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:46.958347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:46.992330 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98307ff8-3a79-4c19-ad1e-4bee4016aa22 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:47.031803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d4cd4-84f8-46a7-a64b-533295e10ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:47.032542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d4cd4-84f8-46a7-a64b-533295e10ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:47.032826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d4cd4-84f8-46a7-a64b-533295e10ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:47.033102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d4cd4-84f8-46a7-a64b-533295e10ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:47.033849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d4cd4-84f8-46a7-a64b-533295e10ee8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:47.034152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d4cd4-84f8-46a7-a64b-533295e10ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:47.035538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d4cd4-84f8-46a7-a64b-533295e10ee8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:47.051142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 156/310] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:47.051142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d4cd4-84f8-46a7-a64b-533295e10ee8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:47.068225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa77da1-2376-428b-a2af-011f6f537c67 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:47.102981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c664-f183-4336-912a-429ceb8f64f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:47.103797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c664-f183-4336-912a-429ceb8f64f1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:47.104092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c664-f183-4336-912a-429ceb8f64f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:47.104381 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c664-f183-4336-912a-429ceb8f64f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:47.114811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096c664-f183-4336-912a-429ceb8f64f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b096c664-f183-4336-912a-429ceb8f64f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:47.123314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:47.124225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:47.129856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 155/311] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:47.132143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c664-f183-4336-912a-429ceb8f64f1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:47.172650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d4cd4-84f8-46a7-a64b-533295e10ee8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:47.180545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:47.208399 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8366cb3-3103-4d37-96e3-cb6dafed2efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:47.209288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8366cb3-3103-4d37-96e3-cb6dafed2efc None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:47.209572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8366cb3-3103-4d37-96e3-cb6dafed2efc None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:47.209850 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8366cb3-3103-4d37-96e3-cb6dafed2efc None admin] PATH_INFO: `/v3/users/eed34424149f45adb3c532fed7bd63d4` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:47.217997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8366cb3-3103-4d37-96e3-cb6dafed2efc None admin] RBAC: Authorizing `identity:get_user(user_id=eed34424149f45adb3c532fed7bd63d4)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:47.217997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8366cb3-3103-4d37-96e3-cb6dafed2efc None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:47.217997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 157/312] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:47 2022] GET /identity/v3/users/eed34424149f45adb3c532fed7bd63d4 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:47.223184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8366cb3-3103-4d37-96e3-cb6dafed2efc None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:47.234414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:47.252315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c664-f183-4336-912a-429ceb8f64f1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:47.290069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7735c7-b4c7-422f-af97-f8ca7c7ea561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:47.291114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7735c7-b4c7-422f-af97-f8ca7c7ea561 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:47.291717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7735c7-b4c7-422f-af97-f8ca7c7ea561 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:47.292274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7735c7-b4c7-422f-af97-f8ca7c7ea561 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:47.294393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7735c7-b4c7-422f-af97-f8ca7c7ea561 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:47.294913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7735c7-b4c7-422f-af97-f8ca7c7ea561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:47.296329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7735c7-b4c7-422f-af97-f8ca7c7ea561 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:47.311921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 156/313] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:47.313263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7735c7-b4c7-422f-af97-f8ca7c7ea561 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:47.339983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8366cb3-3103-4d37-96e3-cb6dafed2efc None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:47.378346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce964de-8185-4c9b-91e9-0c8a0a785886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:47.379294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce964de-8185-4c9b-91e9-0c8a0a785886 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:47.379612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce964de-8185-4c9b-91e9-0c8a0a785886 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:47.379958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce964de-8185-4c9b-91e9-0c8a0a785886 None admin] PATH_INFO: `/v3/system/users/eed34424149f45adb3c532fed7bd63d4/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:47.381469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce964de-8185-4c9b-91e9-0c8a0a785886 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eed34424149f45adb3c532fed7bd63d4, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:47.383032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce964de-8185-4c9b-91e9-0c8a0a785886 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:47.421416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:47.430643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7735c7-b4c7-422f-af97-f8ca7c7ea561 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:47.463317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16414d-ce40-407f-b053-a16b3ec039eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:47.464238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16414d-ce40-407f-b053-a16b3ec039eb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:47.464524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16414d-ce40-407f-b053-a16b3ec039eb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:47.464797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16414d-ce40-407f-b053-a16b3ec039eb None admin] PATH_INFO: `/v3/users/70cd912f6ee647a3a8b4187320ae338a` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:47.466493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16414d-ce40-407f-b053-a16b3ec039eb None admin] RBAC: Authorizing `identity:get_user(user_id=70cd912f6ee647a3a8b4187320ae338a)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:47.467943 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16414d-ce40-407f-b053-a16b3ec039eb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:47.469854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 157/314] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:47 2022] GET /identity/v3/users/70cd912f6ee647a3a8b4187320ae338a => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:47.474841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16414d-ce40-407f-b053-a16b3ec039eb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:47.544388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 158/315] 10.222.0.77 () {58 vars in 1334 bytes} [Thu Jun 16 17:16:47 2022] PUT /identity/v3/system/users/eed34424149f45adb3c532fed7bd63d4/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:16:47.582235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16414d-ce40-407f-b053-a16b3ec039eb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:47.623686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c008-4c58-4e85-bc3d-c124f4198b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:47.624398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c008-4c58-4e85-bc3d-c124f4198b4d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:47.624689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c008-4c58-4e85-bc3d-c124f4198b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:47.624969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c008-4c58-4e85-bc3d-c124f4198b4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:47.661281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:47.707593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032c008-4c58-4e85-bc3d-c124f4198b4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:47.709034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032c008-4c58-4e85-bc3d-c124f4198b4d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:47.816918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 158/316] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:16:47.822648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce964de-8185-4c9b-91e9-0c8a0a785886 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:47.902376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:47.936680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce964de-8185-4c9b-91e9-0c8a0a785886 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:47.974519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59980aa-c1f5-4806-826e-f0a374f278e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:47.975316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59980aa-c1f5-4806-826e-f0a374f278e8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:47.975604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59980aa-c1f5-4806-826e-f0a374f278e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:47.975882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59980aa-c1f5-4806-826e-f0a374f278e8 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:47.977112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59980aa-c1f5-4806-826e-f0a374f278e8 None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:47.978567 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59980aa-c1f5-4806-826e-f0a374f278e8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:47.980661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 159/317] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:47 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:47.986634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c008-4c58-4e85-bc3d-c124f4198b4d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:48.051889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:48.097396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c008-4c58-4e85-bc3d-c124f4198b4d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:48.137143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2c716-443d-4c1b-b487-a6dcca12ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:48.138264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c716-443d-4c1b-b487-a6dcca12ae91 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:48.138827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c716-443d-4c1b-b487-a6dcca12ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:48.139318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c716-443d-4c1b-b487-a6dcca12ae91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:48.140669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c716-443d-4c1b-b487-a6dcca12ae91 None admin] RBAC: Adding query filter params (role.id=7050c29529de40c183462f4e9474abcf, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1, user.id=70cd912f6ee647a3a8b4187320ae338a) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:48.141176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c716-443d-4c1b-b487-a6dcca12ae91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:48.142819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c716-443d-4c1b-b487-a6dcca12ae91 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:48.149892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 159/318] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:16:47 2022] GET /identity/v3/role_assignments?user.id=70cd912f6ee647a3a8b4187320ae338a&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=7050c29529de40c183462f4e9474abcf => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:48.693253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02e77-bdd1-42b1-850d-bcccc0af5605 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:48.693602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02e77-bdd1-42b1-850d-bcccc0af5605 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:48.693812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02e77-bdd1-42b1-850d-bcccc0af5605 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:48.695319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 160/319] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:48.700449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13186-5152-4270-88e7-108a3f916b24 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:48.700851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13186-5152-4270-88e7-108a3f916b24 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:48.701099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13186-5152-4270-88e7-108a3f916b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:48.719287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-62c13186-5152-4270-88e7-108a3f916b24 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:48.720513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-62c13186-5152-4270-88e7-108a3f916b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:48.789463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 160/320] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:48.812435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de02e77-bdd1-42b1-850d-bcccc0af5605 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:48.919406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de02e77-bdd1-42b1-850d-bcccc0af5605 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:48.956970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3078e-7548-4880-9990-35d42461fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:48.957784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3078e-7548-4880-9990-35d42461fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:48.958064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3078e-7548-4880-9990-35d42461fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:48.958335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3078e-7548-4880-9990-35d42461fdf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:48.959523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3078e-7548-4880-9990-35d42461fdf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:48.961010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3078e-7548-4880-9990-35d42461fdf5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:48.962902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 161/321] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:16:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:48.969471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13186-5152-4270-88e7-108a3f916b24 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:48.998597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282b54c-86ca-4f78-bb4e-4b60ed060edc None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:48.999111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282b54c-86ca-4f78-bb4e-4b60ed060edc None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:48.999215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282b54c-86ca-4f78-bb4e-4b60ed060edc None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.000522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 162/322] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:49.005207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2f651-9e33-4b44-8455-08bd812941ac None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:49.005495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2f651-9e33-4b44-8455-08bd812941ac None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:49.005773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2f651-9e33-4b44-8455-08bd812941ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.018491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:49.024598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-41d2f651-9e33-4b44-8455-08bd812941ac None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:49.025798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-41d2f651-9e33-4b44-8455-08bd812941ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:49.028444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:49.075291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13186-5152-4270-88e7-108a3f916b24 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:49.096679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 163/323] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:49.112267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833023d-3b9a-4a5e-a922-a50c2792d175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:49.113564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833023d-3b9a-4a5e-a922-a50c2792d175 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:49.114020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833023d-3b9a-4a5e-a922-a50c2792d175 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:49.114498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833023d-3b9a-4a5e-a922-a50c2792d175 None admin] PATH_INFO: `/v3/groups` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.115356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833023d-3b9a-4a5e-a922-a50c2792d175 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:49.117120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833023d-3b9a-4a5e-a922-a50c2792d175 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:49.119376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2f651-9e33-4b44-8455-08bd812941ac None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:49.205741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 161/324] 10.222.0.77 () {60 vars in 1134 bytes} [Thu Jun 16 17:16:48 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:16:49.239081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2f651-9e33-4b44-8455-08bd812941ac None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:49.278880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa1103-ae29-4331-8dd7-98f2024af516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:49.279702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa1103-ae29-4331-8dd7-98f2024af516 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:49.279989 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa1103-ae29-4331-8dd7-98f2024af516 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:49.280301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa1103-ae29-4331-8dd7-98f2024af516 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.283547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:49.293508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa1103-ae29-4331-8dd7-98f2024af516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-66fa1103-ae29-4331-8dd7-98f2024af516 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:49.301754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:49.302723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:49.308628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 164/325] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:49.312367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833023d-3b9a-4a5e-a922-a50c2792d175 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:49.426678 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833023d-3b9a-4a5e-a922-a50c2792d175 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:49.440814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:49.462135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d39fcd-1fc8-4626-929d-62a1e7deb998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:49.462746 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d39fcd-1fc8-4626-929d-62a1e7deb998 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:49.463026 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d39fcd-1fc8-4626-929d-62a1e7deb998 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:49.463296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d39fcd-1fc8-4626-929d-62a1e7deb998 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.464037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d39fcd-1fc8-4626-929d-62a1e7deb998 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:49.464383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d39fcd-1fc8-4626-929d-62a1e7deb998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:49.465830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d39fcd-1fc8-4626-929d-62a1e7deb998 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:49.475917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 162/326] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:49.481978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa1103-ae29-4331-8dd7-98f2024af516 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:49.598447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa1103-ae29-4331-8dd7-98f2024af516 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:49.635814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5cc84-8456-4a06-b653-2bfad0e08500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:49.636745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5cc84-8456-4a06-b653-2bfad0e08500 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:49.637029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5cc84-8456-4a06-b653-2bfad0e08500 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:49.637338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5cc84-8456-4a06-b653-2bfad0e08500 None admin] PATH_INFO: `/v3/users/e1f2ed52038040a98dc3ce466264a2c9` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.638666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5cc84-8456-4a06-b653-2bfad0e08500 None admin] RBAC: Authorizing `identity:get_user(user_id=e1f2ed52038040a98dc3ce466264a2c9)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:49.640186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5cc84-8456-4a06-b653-2bfad0e08500 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:49.642447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 165/327] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:49 2022] GET /identity/v3/users/e1f2ed52038040a98dc3ce466264a2c9 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:49.647993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d39fcd-1fc8-4626-929d-62a1e7deb998 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:49.770954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d39fcd-1fc8-4626-929d-62a1e7deb998 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:49.802759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878389-2a7f-482c-aca3-fb30018b309c None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:49.803710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878389-2a7f-482c-aca3-fb30018b309c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:49.803710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878389-2a7f-482c-aca3-fb30018b309c None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.804865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 166/328] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:49.807620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a357e4-de96-410c-a614-e16eaa272fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:49.808621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a357e4-de96-410c-a614-e16eaa272fc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:49.808906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a357e4-de96-410c-a614-e16eaa272fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:49.809317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a357e4-de96-410c-a614-e16eaa272fc7 None admin] PATH_INFO: `/v3/system/users/e1f2ed52038040a98dc3ce466264a2c9/roles/7050c29529de40c183462f4e9474abcf` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.811003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf3709-9862-4181-977e-bc01a3022994 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:49.811139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a357e4-de96-410c-a614-e16eaa272fc7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e1f2ed52038040a98dc3ce466264a2c9, role_id=7050c29529de40c183462f4e9474abcf)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:49.811346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf3709-9862-4181-977e-bc01a3022994 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:49.811578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf3709-9862-4181-977e-bc01a3022994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:49.812454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a357e4-de96-410c-a614-e16eaa272fc7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:49.831650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-83bf3709-9862-4181-977e-bc01a3022994 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:49.832887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-83bf3709-9862-4181-977e-bc01a3022994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:49.906895 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:49.917449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 167/329] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:49.932530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 163/330] 10.222.0.77 () {58 vars in 1334 bytes} [Thu Jun 16 17:16:49 2022] PUT /identity/v3/system/users/e1f2ed52038040a98dc3ce466264a2c9/roles/7050c29529de40c183462f4e9474abcf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:16:49.946527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf3709-9862-4181-977e-bc01a3022994 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:50.099318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf3709-9862-4181-977e-bc01a3022994 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:50.147136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e9714-6fe3-4220-9a24-26fe064d2560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:50.148256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9714-6fe3-4220-9a24-26fe064d2560 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:50.148700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9714-6fe3-4220-9a24-26fe064d2560 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:50.149173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9714-6fe3-4220-9a24-26fe064d2560 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:50.162585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e9714-6fe3-4220-9a24-26fe064d2560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-112e9714-6fe3-4220-9a24-26fe064d2560 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:50.172291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:50.173394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:50.174371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:50.176793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 168/331] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:50.183054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a357e4-de96-410c-a614-e16eaa272fc7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:50.240466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:50.315540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a357e4-de96-410c-a614-e16eaa272fc7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:50.366322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b8ffd-e434-40df-9d5e-9b34c8994299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:50.366929 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b8ffd-e434-40df-9d5e-9b34c8994299 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:50.367210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b8ffd-e434-40df-9d5e-9b34c8994299 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:50.367486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b8ffd-e434-40df-9d5e-9b34c8994299 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:50.368265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b8ffd-e434-40df-9d5e-9b34c8994299 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:50.368571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b8ffd-e434-40df-9d5e-9b34c8994299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:50.369951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b8ffd-e434-40df-9d5e-9b34c8994299 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:50.382834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 164/332] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:50.389379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e9714-6fe3-4220-9a24-26fe064d2560 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:50.488458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:50.544290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e9714-6fe3-4220-9a24-26fe064d2560 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:50.590233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904f520-27c6-4487-a1c5-36d33ea15dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:50.591421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904f520-27c6-4487-a1c5-36d33ea15dac None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:50.591704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904f520-27c6-4487-a1c5-36d33ea15dac None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:50.591976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904f520-27c6-4487-a1c5-36d33ea15dac None admin] PATH_INFO: `/v3/users/eed34424149f45adb3c532fed7bd63d4` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:50.593255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904f520-27c6-4487-a1c5-36d33ea15dac None admin] RBAC: Authorizing `identity:get_user(user_id=eed34424149f45adb3c532fed7bd63d4)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:50.594715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904f520-27c6-4487-a1c5-36d33ea15dac None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:50.600179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 169/333] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:50 2022] GET /identity/v3/users/eed34424149f45adb3c532fed7bd63d4 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:50.603877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b8ffd-e434-40df-9d5e-9b34c8994299 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:50.724556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:50.728641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b8ffd-e434-40df-9d5e-9b34c8994299 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:50.771297 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642821b9-ecf5-4ea7-a763-47d58d6b6e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:50.771974 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642821b9-ecf5-4ea7-a763-47d58d6b6e65 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:50.772297 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642821b9-ecf5-4ea7-a763-47d58d6b6e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:50.772570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642821b9-ecf5-4ea7-a763-47d58d6b6e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:50.773402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642821b9-ecf5-4ea7-a763-47d58d6b6e65 None admin] RBAC: Adding query filter params (role.id=14542129036041fa85f7c5223487670d, user.id=eed34424149f45adb3c532fed7bd63d4, scope.system=all) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:50.773715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642821b9-ecf5-4ea7-a763-47d58d6b6e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:50.775159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642821b9-ecf5-4ea7-a763-47d58d6b6e65 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:50.793163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 165/334] 10.222.0.77 () {56 vars in 1308 bytes} [Thu Jun 16 17:16:50 2022] GET /identity/v3/role_assignments?user.id=eed34424149f45adb3c532fed7bd63d4&scope.system=all&role.id=14542129036041fa85f7c5223487670d => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:52.039959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74326ed-d13f-477b-a869-c0e374a2a1e3 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:52.040507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74326ed-d13f-477b-a869-c0e374a2a1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:52.040507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74326ed-d13f-477b-a869-c0e374a2a1e3 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:52.042167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 170/335] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:52.057521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88463a98-3eef-4bd2-978a-1c4a4427bbc5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:52.057965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88463a98-3eef-4bd2-978a-1c4a4427bbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:52.058074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88463a98-3eef-4bd2-978a-1c4a4427bbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:52.080497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-88463a98-3eef-4bd2-978a-1c4a4427bbc5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:52.081693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-88463a98-3eef-4bd2-978a-1c4a4427bbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:52.162029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 166/336] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:52.205689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74326ed-d13f-477b-a869-c0e374a2a1e3 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:52.337230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74326ed-d13f-477b-a869-c0e374a2a1e3 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:52.368151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:52.376054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce78da-5796-4862-8188-a44f0162ff90 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:52.376380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce78da-5796-4862-8188-a44f0162ff90 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:52.376631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce78da-5796-4862-8188-a44f0162ff90 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:52.377998 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 167/337] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:52.383289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9f2e-9096-41b3-8b46-207f2fe7894e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:52.388539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9f2e-9096-41b3-8b46-207f2fe7894e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:52.388539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9f2e-9096-41b3-8b46-207f2fe7894e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:52.388846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5977e-6df6-48b3-9462-fbdcccab5f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:52.389730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5977e-6df6-48b3-9462-fbdcccab5f3c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:52.390022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5977e-6df6-48b3-9462-fbdcccab5f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:52.390559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5977e-6df6-48b3-9462-fbdcccab5f3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:52.411669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5977e-6df6-48b3-9462-fbdcccab5f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:52.413612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-174c9f2e-9096-41b3-8b46-207f2fe7894e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:52.414805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-174c9f2e-9096-41b3-8b46-207f2fe7894e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b6b5977e-6df6-48b3-9462-fbdcccab5f3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:52.422156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:52.423059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:52.423852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 171/338] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:52.433473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5977e-6df6-48b3-9462-fbdcccab5f3c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:52.523862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 168/339] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:52.565162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9f2e-9096-41b3-8b46-207f2fe7894e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:52.617655 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5977e-6df6-48b3-9462-fbdcccab5f3c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:52.632383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:52.718057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8d1e-0256-4e89-a718-ab332eb3c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:52.718741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8d1e-0256-4e89-a718-ab332eb3c902 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:52.719030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8d1e-0256-4e89-a718-ab332eb3c902 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:52.719308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d8d1e-0256-4e89-a718-ab332eb3c902 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:52.720093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d8d1e-0256-4e89-a718-ab332eb3c902 None admin] RBAC: Adding query filter params (name=member) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:52.720408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d8d1e-0256-4e89-a718-ab332eb3c902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:52.721802 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d8d1e-0256-4e89-a718-ab332eb3c902 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:52.738020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 172/340] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:52.746693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8d1e-0256-4e89-a718-ab332eb3c902 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:52.831594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9f2e-9096-41b3-8b46-207f2fe7894e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:52.856794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:52.908611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a394623-b8a8-4422-b250-bac761f4946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:52.909421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a394623-b8a8-4422-b250-bac761f4946a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:52.909712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a394623-b8a8-4422-b250-bac761f4946a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:52.909989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a394623-b8a8-4422-b250-bac761f4946a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:52.930654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a394623-b8a8-4422-b250-bac761f4946a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2a394623-b8a8-4422-b250-bac761f4946a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:52.939578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:52.941686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:52.942501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:52.952711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 169/341] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:16:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:52.958698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a394623-b8a8-4422-b250-bac761f4946a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:52.959990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d8d1e-0256-4e89-a718-ab332eb3c902 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:53.030737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd5469-fe1b-436f-b80b-87d780a4ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:53.031407 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd5469-fe1b-436f-b80b-87d780a4ba37 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.031693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd5469-fe1b-436f-b80b-87d780a4ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.031971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd5469-fe1b-436f-b80b-87d780a4ba37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.085988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:53.275575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a394623-b8a8-4422-b250-bac761f4946a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:53.321821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf14be-b3fc-4cf7-b545-c2f18cb623b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:53.322827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf14be-b3fc-4cf7-b545-c2f18cb623b2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.323445 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf14be-b3fc-4cf7-b545-c2f18cb623b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.323919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf14be-b3fc-4cf7-b545-c2f18cb623b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.325839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf14be-b3fc-4cf7-b545-c2f18cb623b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:53.326365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf14be-b3fc-4cf7-b545-c2f18cb623b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:53.327940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf14be-b3fc-4cf7-b545-c2f18cb623b2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:53.335791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd5469-fe1b-436f-b80b-87d780a4ba37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:53.337303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd5469-fe1b-436f-b80b-87d780a4ba37 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:53.339292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 170/342] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:16:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:53.352309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875434-8576-4476-9c88-610aae84cc83 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.352991 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875434-8576-4476-9c88-610aae84cc83 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.353451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875434-8576-4476-9c88-610aae84cc83 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.355436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 171/343] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:53 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:53.357671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48875434-8576-4476-9c88-610aae84cc83 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:53.462067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:53.531804 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48875434-8576-4476-9c88-610aae84cc83 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:53.542859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 173/344] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:53.545280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e22ea9-2847-4ad6-addc-a03fbac6445f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.545776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e22ea9-2847-4ad6-addc-a03fbac6445f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.546250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e22ea9-2847-4ad6-addc-a03fbac6445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.567458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-07e22ea9-2847-4ad6-addc-a03fbac6445f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:53.569022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-07e22ea9-2847-4ad6-addc-a03fbac6445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:53.592835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc1c8e-d4a5-4a40-90db-0dc4558c770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:53.593697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc1c8e-d4a5-4a40-90db-0dc4558c770e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.594075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc1c8e-d4a5-4a40-90db-0dc4558c770e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.594462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc1c8e-d4a5-4a40-90db-0dc4558c770e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.607837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:53.667076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 174/345] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:53.668514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f63fab-b7b3-4280-8b05-ceb2a41bf77e None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.668797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f63fab-b7b3-4280-8b05-ceb2a41bf77e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.669073 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f63fab-b7b3-4280-8b05-ceb2a41bf77e None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.670498 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 175/346] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:53.671027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f63fab-b7b3-4280-8b05-ceb2a41bf77e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:53.687666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc1c8e-d4a5-4a40-90db-0dc4558c770e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:53.689437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc1c8e-d4a5-4a40-90db-0dc4558c770e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:53.780166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:53.804921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 172/347] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:53.806948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c2e70-a56f-4cdb-8a9f-c2276d0e32e3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.807232 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f63fab-b7b3-4280-8b05-ceb2a41bf77e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:53.807549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c2e70-a56f-4cdb-8a9f-c2276d0e32e3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.808040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c2e70-a56f-4cdb-8a9f-c2276d0e32e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.827157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9d1c2e70-a56f-4cdb-8a9f-c2276d0e32e3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:53.828715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9d1c2e70-a56f-4cdb-8a9f-c2276d0e32e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:53.846565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c7b1-bd2c-4482-b61d-c292fb21ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:53.847443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c7b1-bd2c-4482-b61d-c292fb21ae81 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:53.847726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c7b1-bd2c-4482-b61d-c292fb21ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:53.848000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c7b1-bd2c-4482-b61d-c292fb21ae81 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:53.849271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8c7b1-bd2c-4482-b61d-c292fb21ae81 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:53.850966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8c7b1-bd2c-4482-b61d-c292fb21ae81 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:53.852944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 176/348] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:53 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:53.853936 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c7b1-bd2c-4482-b61d-c292fb21ae81 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:53.881451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:53.914199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 173/349] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:53.915803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c2e70-a56f-4cdb-8a9f-c2276d0e32e3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:53.972395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c7b1-bd2c-4482-b61d-c292fb21ae81 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:54.020887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeae391-a4a9-4df2-9f5e-e7509ef03d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:54.022078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeae391-a4a9-4df2-9f5e-e7509ef03d13 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.022566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeae391-a4a9-4df2-9f5e-e7509ef03d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.022983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeae391-a4a9-4df2-9f5e-e7509ef03d13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.037306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeae391-a4a9-4df2-9f5e-e7509ef03d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-4aeae391-a4a9-4df2-9f5e-e7509ef03d13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:54.045425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:54.046375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 17:16:54.047185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:54.047778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c2e70-a56f-4cdb-8a9f-c2276d0e32e3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:54.049521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 177/350] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:54.050504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeae391-a4a9-4df2-9f5e-e7509ef03d13 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:54.053670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:54.087450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f9a6-c59b-4f9f-a42b-4338bc35fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:54.089032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f9a6-c59b-4f9f-a42b-4338bc35fcdd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.089501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f9a6-c59b-4f9f-a42b-4338bc35fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.089786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f9a6-c59b-4f9f-a42b-4338bc35fcdd None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.091343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9f9a6-c59b-4f9f-a42b-4338bc35fcdd None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:54.092990 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9f9a6-c59b-4f9f-a42b-4338bc35fcdd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:54.094882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 174/351] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:53 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:54.095707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f9a6-c59b-4f9f-a42b-4338bc35fcdd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:54.161332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:54.185376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeae391-a4a9-4df2-9f5e-e7509ef03d13 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:54.223528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca388d8-c3d2-4e35-8b73-21e6ada36ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:54.224422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca388d8-c3d2-4e35-8b73-21e6ada36ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.224710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca388d8-c3d2-4e35-8b73-21e6ada36ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.224992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca388d8-c3d2-4e35-8b73-21e6ada36ea3 None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.231749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca388d8-c3d2-4e35-8b73-21e6ada36ea3 None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:54.233423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca388d8-c3d2-4e35-8b73-21e6ada36ea3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:54.235286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 178/352] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:16:54 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:54.235404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f9a6-c59b-4f9f-a42b-4338bc35fcdd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:54.236391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7272bf-efea-40fd-9981-13edc990c79b None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.236683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7272bf-efea-40fd-9981-13edc990c79b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.236994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7272bf-efea-40fd-9981-13edc990c79b None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.238207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 179/353] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:54.238906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7272bf-efea-40fd-9981-13edc990c79b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:54.280216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d4015-770a-4298-96c1-19332a05a96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:54.281042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4015-770a-4298-96c1-19332a05a96a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.281326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4015-770a-4298-96c1-19332a05a96a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.281609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4015-770a-4298-96c1-19332a05a96a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.296247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d4015-770a-4298-96c1-19332a05a96a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5e8d4015-770a-4298-96c1-19332a05a96a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:54.305193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:54.306051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:54.307080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 175/354] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:54.307915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d4015-770a-4298-96c1-19332a05a96a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:54.318513 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:54.358697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7272bf-efea-40fd-9981-13edc990c79b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:54.407927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494e971-a1c2-43a0-b98a-440bbca012d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:54.409093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e971-a1c2-43a0-b98a-440bbca012d8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.409382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e971-a1c2-43a0-b98a-440bbca012d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.409676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e971-a1c2-43a0-b98a-440bbca012d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.410577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494e971-a1c2-43a0-b98a-440bbca012d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:54.410892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494e971-a1c2-43a0-b98a-440bbca012d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:54.412398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494e971-a1c2-43a0-b98a-440bbca012d8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:54.422329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:54.424469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 180/355] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:54.432169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167349c-7d59-4dfb-8b4e-d0eaf66edb24 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.432169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167349c-7d59-4dfb-8b4e-d0eaf66edb24 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.432169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167349c-7d59-4dfb-8b4e-d0eaf66edb24 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.432476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d4015-770a-4298-96c1-19332a05a96a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:54.432551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 181/356] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:54.432551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaa545-0815-4891-bc43-782957f367dc None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.432551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaa545-0815-4891-bc43-782957f367dc None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.432551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaa545-0815-4891-bc43-782957f367dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.447027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-2bdaa545-0815-4891-bc43-782957f367dc None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:54.448315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-2bdaa545-0815-4891-bc43-782957f367dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:54.463965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86922c2b-2be9-4a1a-a683-00300d96e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:54.464868 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922c2b-2be9-4a1a-a683-00300d96e346 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.465687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922c2b-2be9-4a1a-a683-00300d96e346 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.466117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922c2b-2be9-4a1a-a683-00300d96e346 None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.467420 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86922c2b-2be9-4a1a-a683-00300d96e346 None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:54.469056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86922c2b-2be9-4a1a-a683-00300d96e346 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:54.470793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 176/357] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:16:54 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:54.471601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86922c2b-2be9-4a1a-a683-00300d96e346 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:54.532844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 182/358] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:54.534527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaa545-0815-4891-bc43-782957f367dc None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:54.598453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86922c2b-2be9-4a1a-a683-00300d96e346 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:54.611562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:54.641281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f50c-797b-454d-a786-d87272d259fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:54.642129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f50c-797b-454d-a786-d87272d259fe None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.642418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f50c-797b-454d-a786-d87272d259fe None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.644133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f50c-797b-454d-a786-d87272d259fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.644133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5f50c-797b-454d-a786-d87272d259fe None admin] RBAC: Adding query filter params (group.id=e56c98eb878a426f9e81b51b813841bb, role.id=14542129036041fa85f7c5223487670d, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:54.644133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5f50c-797b-454d-a786-d87272d259fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:54.645314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5f50c-797b-454d-a786-d87272d259fe None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:54.651714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 177/359] 10.222.0.77 () {56 vars in 1376 bytes} [Thu Jun 16 17:16:54 2022] GET /identity/v3/role_assignments?group.id=e56c98eb878a426f9e81b51b813841bb&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=14542129036041fa85f7c5223487670d => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:54.652679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f50c-797b-454d-a786-d87272d259fe None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:54.673610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaa545-0815-4891-bc43-782957f367dc None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:54.701167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:54.730156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b03b7-c990-4272-a666-0c40ebb330b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:54.731261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b03b7-c990-4272-a666-0c40ebb330b7 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.731558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b03b7-c990-4272-a666-0c40ebb330b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.731847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b03b7-c990-4272-a666-0c40ebb330b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.733028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b03b7-c990-4272-a666-0c40ebb330b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:54.733344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b03b7-c990-4272-a666-0c40ebb330b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:54.734786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b03b7-c990-4272-a666-0c40ebb330b7 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:54.744290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 183/360] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:54.745611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766548d-edcc-4648-9122-c394b415a4d2 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.745904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766548d-edcc-4648-9122-c394b415a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.746189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766548d-edcc-4648-9122-c394b415a4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.770083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3766548d-edcc-4648-9122-c394b415a4d2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:54.771315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3766548d-edcc-4648-9122-c394b415a4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:54.797707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f50c-797b-454d-a786-d87272d259fe None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:54.849023 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd700-9fff-4888-afdb-9541a618f13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:54.849918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd700-9fff-4888-afdb-9541a618f13d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:54.850203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd700-9fff-4888-afdb-9541a618f13d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:54.850473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd700-9fff-4888-afdb-9541a618f13d None admin] PATH_INFO: `/v3/users/e1f2ed52038040a98dc3ce466264a2c9` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:54.851685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effd700-9fff-4888-afdb-9541a618f13d None admin] RBAC: Authorizing `identity:get_user(user_id=e1f2ed52038040a98dc3ce466264a2c9)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:54.853194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effd700-9fff-4888-afdb-9541a618f13d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:54.855162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 178/361] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:16:54 2022] GET /identity/v3/users/e1f2ed52038040a98dc3ce466264a2c9 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:54.856594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd700-9fff-4888-afdb-9541a618f13d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:54.875985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 184/362] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:54.875985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766548d-edcc-4648-9122-c394b415a4d2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:54.938050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:54.994846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:55.000161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd700-9fff-4888-afdb-9541a618f13d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:55.008103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766548d-edcc-4648-9122-c394b415a4d2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:55.050228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3dd96-dc0d-4a0f-b631-f1defefc6221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:55.051170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3dd96-dc0d-4a0f-b631-f1defefc6221 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:55.051371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95337-7388-4115-8d0d-5645f07e6ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:55.051480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3dd96-dc0d-4a0f-b631-f1defefc6221 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:55.051724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3dd96-dc0d-4a0f-b631-f1defefc6221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:55.053856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95337-7388-4115-8d0d-5645f07e6ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:55.053856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95337-7388-4115-8d0d-5645f07e6ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:55.054018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3dd96-dc0d-4a0f-b631-f1defefc6221 None admin] RBAC: Adding query filter params (group.id=e56c98eb878a426f9e81b51b813841bb, role.id=fd4cb9f5c4fb444498c049489198e975, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:55.054087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95337-7388-4115-8d0d-5645f07e6ea7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:55.054173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3dd96-dc0d-4a0f-b631-f1defefc6221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:55.054710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3dd96-dc0d-4a0f-b631-f1defefc6221 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:55.061525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 179/363] 10.222.0.77 () {56 vars in 1376 bytes} [Thu Jun 16 17:16:54 2022] GET /identity/v3/role_assignments?group.id=e56c98eb878a426f9e81b51b813841bb&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=fd4cb9f5c4fb444498c049489198e975 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:55.062121 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3dd96-dc0d-4a0f-b631-f1defefc6221 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:55.068098 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec95337-7388-4115-8d0d-5645f07e6ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-4ec95337-7388-4115-8d0d-5645f07e6ea7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:55.078006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:55.079009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:55.080493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 185/364] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:16:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:55.081166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95337-7388-4115-8d0d-5645f07e6ea7 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:55.204440 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95337-7388-4115-8d0d-5645f07e6ea7 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:55.218211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:55.240120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3dd96-dc0d-4a0f-b631-f1defefc6221 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:55.248894 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc32e3b-4c7e-446b-a61f-f527c01566b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:55.249569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc32e3b-4c7e-446b-a61f-f527c01566b6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:55.249864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc32e3b-4c7e-446b-a61f-f527c01566b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:55.250509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc32e3b-4c7e-446b-a61f-f527c01566b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:55.250967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc32e3b-4c7e-446b-a61f-f527c01566b6 None admin] RBAC: Adding query filter params (role.id=7050c29529de40c183462f4e9474abcf, user.id=e1f2ed52038040a98dc3ce466264a2c9, scope.system=all) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:55.253209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc32e3b-4c7e-446b-a61f-f527c01566b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:55.255872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc32e3b-4c7e-446b-a61f-f527c01566b6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:55.272516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 186/365] 10.222.0.77 () {56 vars in 1308 bytes} [Thu Jun 16 17:16:55 2022] GET /identity/v3/role_assignments?user.id=e1f2ed52038040a98dc3ce466264a2c9&scope.system=all&role.id=7050c29529de40c183462f4e9474abcf => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:55.273213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc32e3b-4c7e-446b-a61f-f527c01566b6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:55.284299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d9be-983f-40bf-bbe8-3fb016d8fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:55.284977 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d9be-983f-40bf-bbe8-3fb016d8fac9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:55.285262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d9be-983f-40bf-bbe8-3fb016d8fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:55.285539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d9be-983f-40bf-bbe8-3fb016d8fac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:55.329384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:55.407337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281d9be-983f-40bf-bbe8-3fb016d8fac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:55.408896 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281d9be-983f-40bf-bbe8-3fb016d8fac9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:55.451039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc32e3b-4c7e-446b-a61f-f527c01566b6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:55.503481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71dfb9-a8c6-4f0e-afa0-2cc78f69ef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:55.504268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71dfb9-a8c6-4f0e-afa0-2cc78f69ef17 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:55.504560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71dfb9-a8c6-4f0e-afa0-2cc78f69ef17 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:55.504840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71dfb9-a8c6-4f0e-afa0-2cc78f69ef17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:55.519498 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71dfb9-a8c6-4f0e-afa0-2cc78f69ef17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-5e71dfb9-a8c6-4f0e-afa0-2cc78f69ef17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:55.529822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:55.530742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:16:55.531520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:55.534019 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 187/366] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:55.535076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71dfb9-a8c6-4f0e-afa0-2cc78f69ef17 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:55.576269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:55.620103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 180/367] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:55.620103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d9be-983f-40bf-bbe8-3fb016d8fac9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:55.681408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71dfb9-a8c6-4f0e-afa0-2cc78f69ef17 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:55.691954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:55.727615 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d52c6-8ee1-4fb8-b112-44ced19a418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:55.728210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d52c6-8ee1-4fb8-b112-44ced19a418a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:55.728553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d52c6-8ee1-4fb8-b112-44ced19a418a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:55.728837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d52c6-8ee1-4fb8-b112-44ced19a418a None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:55.729665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d52c6-8ee1-4fb8-b112-44ced19a418a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:55.729940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d52c6-8ee1-4fb8-b112-44ced19a418a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:55.731967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d52c6-8ee1-4fb8-b112-44ced19a418a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:55.744149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 188/368] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:16:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:55.744859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d9be-983f-40bf-bbe8-3fb016d8fac9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:55.745057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d52c6-8ee1-4fb8-b112-44ced19a418a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:55.794239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbe789-9f36-41e2-bbbb-a8afeb4a60e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:55.794849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbe789-9f36-41e2-bbbb-a8afeb4a60e7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:55.795133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbe789-9f36-41e2-bbbb-a8afeb4a60e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:55.795409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbe789-9f36-41e2-bbbb-a8afeb4a60e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:55.796194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbe789-9f36-41e2-bbbb-a8afeb4a60e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:55.796504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbe789-9f36-41e2-bbbb-a8afeb4a60e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:55.798135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbe789-9f36-41e2-bbbb-a8afeb4a60e7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:55.810186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 181/369] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:55.811212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbe789-9f36-41e2-bbbb-a8afeb4a60e7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:55.877939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:55.891412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d52c6-8ee1-4fb8-b112-44ced19a418a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:55.942046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb99b50-3354-4e89-9899-f2958a35af6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:55.942046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb99b50-3354-4e89-9899-f2958a35af6a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:55.942327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb99b50-3354-4e89-9899-f2958a35af6a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:55.942592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb99b50-3354-4e89-9899-f2958a35af6a None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:55.944290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb99b50-3354-4e89-9899-f2958a35af6a None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:55.946542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb99b50-3354-4e89-9899-f2958a35af6a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:55.948281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbe789-9f36-41e2-bbbb-a8afeb4a60e7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:55.948714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 189/370] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:55 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:55.949619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb99b50-3354-4e89-9899-f2958a35af6a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:55.989518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:56.003033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402167c-8208-4ec7-99d3-622462762ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:56.004150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402167c-8208-4ec7-99d3-622462762ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:56.009358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402167c-8208-4ec7-99d3-622462762ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:56.009358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402167c-8208-4ec7-99d3-622462762ba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:56.079887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb99b50-3354-4e89-9899-f2958a35af6a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:56.094752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402167c-8208-4ec7-99d3-622462762ba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:56.097246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402167c-8208-4ec7-99d3-622462762ba5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:56.120354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd5e1-b82c-4206-890d-e7d4f48e9b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:56.121022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd5e1-b82c-4206-890d-e7d4f48e9b6a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:56.121829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd5e1-b82c-4206-890d-e7d4f48e9b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:56.122116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd5e1-b82c-4206-890d-e7d4f48e9b6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:56.168468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:56.201832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bd5e1-b82c-4206-890d-e7d4f48e9b6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:56.203399 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bd5e1-b82c-4206-890d-e7d4f48e9b6a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:56.284202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 182/371] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:56.285087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402167c-8208-4ec7-99d3-622462762ba5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:56.313674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:56.324237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 190/372] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:16:56.325913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd5e1-b82c-4206-890d-e7d4f48e9b6a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:56.400089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402167c-8208-4ec7-99d3-622462762ba5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:56.410038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:56.459037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d72dd8-e029-4560-8c62-6cc0dea88257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:56.460393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd5e1-b82c-4206-890d-e7d4f48e9b6a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:56.460866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d72dd8-e029-4560-8c62-6cc0dea88257 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:56.461883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d72dd8-e029-4560-8c62-6cc0dea88257 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:56.464668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d72dd8-e029-4560-8c62-6cc0dea88257 None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:56.466322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d72dd8-e029-4560-8c62-6cc0dea88257 None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:56.468175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d72dd8-e029-4560-8c62-6cc0dea88257 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:56.471075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 183/373] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:16:56 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:56.472470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d72dd8-e029-4560-8c62-6cc0dea88257 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:56.515382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27627ad3-b215-4615-8187-4b7c5455e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:56.516321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27627ad3-b215-4615-8187-4b7c5455e5cf None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:56.516608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27627ad3-b215-4615-8187-4b7c5455e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:56.516887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27627ad3-b215-4615-8187-4b7c5455e5cf None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:56.518317 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27627ad3-b215-4615-8187-4b7c5455e5cf None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:56.519877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27627ad3-b215-4615-8187-4b7c5455e5cf None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:56.523086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 191/374] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:56 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:56.523889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27627ad3-b215-4615-8187-4b7c5455e5cf None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:56.608194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:56.625022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d72dd8-e029-4560-8c62-6cc0dea88257 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:56.649967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27627ad3-b215-4615-8187-4b7c5455e5cf None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:56.675353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2666b7-d710-4079-a3c2-ff409d81b1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:56.676186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2666b7-d710-4079-a3c2-ff409d81b1ca None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:56.676469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2666b7-d710-4079-a3c2-ff409d81b1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:56.676743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2666b7-d710-4079-a3c2-ff409d81b1ca None admin] PATH_INFO: `/v3/projects/6c79ada12a254f71981d5de110c2a5b7` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:56.678923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2666b7-d710-4079-a3c2-ff409d81b1ca None admin] RBAC: Authorizing `identity:get_project(project_id=6c79ada12a254f71981d5de110c2a5b7)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:56.679399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2666b7-d710-4079-a3c2-ff409d81b1ca None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:56.686946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 184/375] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:56 2022] GET /identity/v3/projects/6c79ada12a254f71981d5de110c2a5b7 => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:56.686946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2666b7-d710-4079-a3c2-ff409d81b1ca None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:56.688678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:56.698735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a926ec-7844-4c21-9f43-ee1d30d171ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:56.700007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a926ec-7844-4c21-9f43-ee1d30d171ad None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:56.700478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a926ec-7844-4c21-9f43-ee1d30d171ad None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:56.704820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a926ec-7844-4c21-9f43-ee1d30d171ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:56.704820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a926ec-7844-4c21-9f43-ee1d30d171ad None admin] RBAC: Adding query filter params (group.id=e56c98eb878a426f9e81b51b813841bb, role.id=14542129036041fa85f7c5223487670d, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:56.704820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a926ec-7844-4c21-9f43-ee1d30d171ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:56.706120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a926ec-7844-4c21-9f43-ee1d30d171ad None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:56.713994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 192/376] 10.222.0.77 () {56 vars in 1376 bytes} [Thu Jun 16 17:16:56 2022] GET /identity/v3/role_assignments?group.id=e56c98eb878a426f9e81b51b813841bb&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=14542129036041fa85f7c5223487670d => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:56.715683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a926ec-7844-4c21-9f43-ee1d30d171ad None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:56.860695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2666b7-d710-4079-a3c2-ff409d81b1ca None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:56.919957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a1f6d-6e5c-4316-a9f9-3fd752419848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:56.920876 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a1f6d-6e5c-4316-a9f9-3fd752419848 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:56.921161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a1f6d-6e5c-4316-a9f9-3fd752419848 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:56.921432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a1f6d-6e5c-4316-a9f9-3fd752419848 None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:56.923031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a1f6d-6e5c-4316-a9f9-3fd752419848 None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:56.924636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a1f6d-6e5c-4316-a9f9-3fd752419848 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:56.929724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 185/377] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:16:56 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:56.936722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a1f6d-6e5c-4316-a9f9-3fd752419848 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:56.993655 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a926ec-7844-4c21-9f43-ee1d30d171ad None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:57.008488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:57.058290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608b2d2-5006-44cf-a59c-0bf066c930e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:57.060409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608b2d2-5006-44cf-a59c-0bf066c930e4 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:57.062267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608b2d2-5006-44cf-a59c-0bf066c930e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:57.063233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608b2d2-5006-44cf-a59c-0bf066c930e4 None admin] PATH_INFO: `/v3/groups/fb7a1d95bc8e4d55aab83f9738345b21` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:57.072778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608b2d2-5006-44cf-a59c-0bf066c930e4 None admin] RBAC: Authorizing `identity:get_group(group_id=fb7a1d95bc8e4d55aab83f9738345b21)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:57.075909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608b2d2-5006-44cf-a59c-0bf066c930e4 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:57.078019 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 193/378] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:16:56 2022] GET /identity/v3/groups/fb7a1d95bc8e4d55aab83f9738345b21 => generated 229 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:57.090119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608b2d2-5006-44cf-a59c-0bf066c930e4 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:57.174073 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a1f6d-6e5c-4316-a9f9-3fd752419848 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:57.205651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:57.233479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feaa9d2-cf26-479e-930d-e63ab9a4b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:57.234146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaa9d2-cf26-479e-930d-e63ab9a4b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:57.234428 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaa9d2-cf26-479e-930d-e63ab9a4b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:57.234702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaa9d2-cf26-479e-930d-e63ab9a4b0c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:57.235518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feaa9d2-cf26-479e-930d-e63ab9a4b0c8 None admin] RBAC: Adding query filter params (group.id=e56c98eb878a426f9e81b51b813841bb, role.id=fd4cb9f5c4fb444498c049489198e975, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:57.235828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feaa9d2-cf26-479e-930d-e63ab9a4b0c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:57.242158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feaa9d2-cf26-479e-930d-e63ab9a4b0c8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:57.256546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 186/379] 10.222.0.77 () {56 vars in 1376 bytes} [Thu Jun 16 17:16:56 2022] GET /identity/v3/role_assignments?group.id=e56c98eb878a426f9e81b51b813841bb&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=fd4cb9f5c4fb444498c049489198e975 => generated 260 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:57.299907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608b2d2-5006-44cf-a59c-0bf066c930e4 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:57.339617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780db09-6251-4f0e-9aa3-37a820f9604c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:57.340220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780db09-6251-4f0e-9aa3-37a820f9604c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:57.340220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780db09-6251-4f0e-9aa3-37a820f9604c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:57.342340 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 187/380] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:57.348145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5a22e-b227-477f-9a49-70b28ca79bbf None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:57.348461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5a22e-b227-477f-9a49-70b28ca79bbf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:57.348719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5a22e-b227-477f-9a49-70b28ca79bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:57.354649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495d47c-c0a8-4bc5-8079-4e498d3b68fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:57.356279 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495d47c-c0a8-4bc5-8079-4e498d3b68fb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:57.356745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495d47c-c0a8-4bc5-8079-4e498d3b68fb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:57.357216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495d47c-c0a8-4bc5-8079-4e498d3b68fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:57.358233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495d47c-c0a8-4bc5-8079-4e498d3b68fb None admin] RBAC: Adding query filter params (group.id=fb7a1d95bc8e4d55aab83f9738345b21, role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=6c79ada12a254f71981d5de110c2a5b7) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:57.358713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495d47c-c0a8-4bc5-8079-4e498d3b68fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:57.360367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495d47c-c0a8-4bc5-8079-4e498d3b68fb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:57.366960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 194/381] 10.222.0.77 () {56 vars in 1376 bytes} [Thu Jun 16 17:16:57 2022] GET /identity/v3/role_assignments?group.id=fb7a1d95bc8e4d55aab83f9738345b21&scope.project.id=6c79ada12a254f71981d5de110c2a5b7&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:57.375543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a9c5a22e-b227-477f-9a49-70b28ca79bbf None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:57.376916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a9c5a22e-b227-477f-9a49-70b28ca79bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:57.461654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 188/382] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:16:57.484552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495d47c-c0a8-4bc5-8079-4e498d3b68fb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:57.625438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495d47c-c0a8-4bc5-8079-4e498d3b68fb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:57.650112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:57.669116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0f35-c95e-4bf2-9f0a-d8ead5827af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:57.670310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0f35-c95e-4bf2-9f0a-d8ead5827af7 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:57.670735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0f35-c95e-4bf2-9f0a-d8ead5827af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:57.671181 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0f35-c95e-4bf2-9f0a-d8ead5827af7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:57.671517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3e94d-042e-4225-b0dc-21e15bc8db95 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:57.671812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3e94d-042e-4225-b0dc-21e15bc8db95 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:57.672167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3e94d-042e-4225-b0dc-21e15bc8db95 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:57.673742 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 189/383] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:57.679650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e6a50-6b95-4b02-b5d2-db3acf5f9f44 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:57.679650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e6a50-6b95-4b02-b5d2-db3acf5f9f44 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:57.679650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e6a50-6b95-4b02-b5d2-db3acf5f9f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:57.690253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0f35-c95e-4bf2-9f0a-d8ead5827af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-e3cc0f35-c95e-4bf2-9f0a-d8ead5827af7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:57.706004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:57.706944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:57.707719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:16:57.711090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 195/384] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:57.713085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1e6e6a50-6b95-4b02-b5d2-db3acf5f9f44 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:57.714207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1e6e6a50-6b95-4b02-b5d2-db3acf5f9f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:57.717936 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0f35-c95e-4bf2-9f0a-d8ead5827af7 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:57.752443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:57.828356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 190/385] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:57.853805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e6a50-6b95-4b02-b5d2-db3acf5f9f44 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:57.902086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0f35-c95e-4bf2-9f0a-d8ead5827af7 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:57.962118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f38cb8-a9ca-4107-b5ab-25730e7a2153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:57.962801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f38cb8-a9ca-4107-b5ab-25730e7a2153 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:57.963083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f38cb8-a9ca-4107-b5ab-25730e7a2153 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:57.963413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f38cb8-a9ca-4107-b5ab-25730e7a2153 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:57.964127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f38cb8-a9ca-4107-b5ab-25730e7a2153 None admin] RBAC: Adding query filter params (name=member) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:57.964438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f38cb8-a9ca-4107-b5ab-25730e7a2153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:57.965881 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f38cb8-a9ca-4107-b5ab-25730e7a2153 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:57.966004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e6a50-6b95-4b02-b5d2-db3acf5f9f44 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:57.992452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 196/386] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:57.993402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f38cb8-a9ca-4107-b5ab-25730e7a2153 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:58.001292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a9be-d089-4a69-9954-83058dc52a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:58.002114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a9be-d089-4a69-9954-83058dc52a7a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:58.002392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a9be-d089-4a69-9954-83058dc52a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:58.002666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a9be-d089-4a69-9954-83058dc52a7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:58.038707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a9be-d089-4a69-9954-83058dc52a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-1f73a9be-d089-4a69-9954-83058dc52a7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:58.048455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:58.049365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:58.050437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 191/387] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:16:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:16:58.055299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a9be-d089-4a69-9954-83058dc52a7a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:58.090981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:58.092422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:58.199664 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f38cb8-a9ca-4107-b5ab-25730e7a2153 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:58.244714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417daf5d-1396-4631-b387-0f4c9b9a4278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:58.245500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417daf5d-1396-4631-b387-0f4c9b9a4278 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:58.245782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417daf5d-1396-4631-b387-0f4c9b9a4278 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:58.246057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417daf5d-1396-4631-b387-0f4c9b9a4278 None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:58.250858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417daf5d-1396-4631-b387-0f4c9b9a4278 None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:58.252356 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417daf5d-1396-4631-b387-0f4c9b9a4278 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:58.254031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 197/388] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:16:57 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:58.259513 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417daf5d-1396-4631-b387-0f4c9b9a4278 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:58.261940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a9be-d089-4a69-9954-83058dc52a7a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:58.321468 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff924ff9-27e9-4aa1-958e-6e90b8dec307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:58.322146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924ff9-27e9-4aa1-958e-6e90b8dec307 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:58.322428 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924ff9-27e9-4aa1-958e-6e90b8dec307 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:58.322705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924ff9-27e9-4aa1-958e-6e90b8dec307 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:58.323598 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff924ff9-27e9-4aa1-958e-6e90b8dec307 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:58.323915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff924ff9-27e9-4aa1-958e-6e90b8dec307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:58.325924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff924ff9-27e9-4aa1-958e-6e90b8dec307 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:58.335018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 192/389] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:16:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:58.341630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff924ff9-27e9-4aa1-958e-6e90b8dec307 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:58.423806 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:58.451233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff924ff9-27e9-4aa1-958e-6e90b8dec307 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:58.487727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54626653-d4f6-4817-80b1-e6481d7166e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:58.488882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626653-d4f6-4817-80b1-e6481d7166e1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:58.489280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626653-d4f6-4817-80b1-e6481d7166e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:58.489810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626653-d4f6-4817-80b1-e6481d7166e1 None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:58.491377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54626653-d4f6-4817-80b1-e6481d7166e1 None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:58.493139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54626653-d4f6-4817-80b1-e6481d7166e1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:58.495343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 193/390] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:16:58 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:58.500985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54626653-d4f6-4817-80b1-e6481d7166e1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:58.506170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417daf5d-1396-4631-b387-0f4c9b9a4278 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:58.526049 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:58.612141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54626653-d4f6-4817-80b1-e6481d7166e1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:58.629336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1324b-6b9c-4dd5-8c5c-3d07d3328ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:58.630227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1324b-6b9c-4dd5-8c5c-3d07d3328ddf None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:58.630513 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1324b-6b9c-4dd5-8c5c-3d07d3328ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:58.630790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1324b-6b9c-4dd5-8c5c-3d07d3328ddf None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:58.631982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1324b-6b9c-4dd5-8c5c-3d07d3328ddf None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:58.633464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1324b-6b9c-4dd5-8c5c-3d07d3328ddf None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:58.640310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 198/391] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:58 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:58.641599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1324b-6b9c-4dd5-8c5c-3d07d3328ddf None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:58.648281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f7a79-fe32-4d6b-aee5-b2d2dcda76d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:58.649260 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7a79-fe32-4d6b-aee5-b2d2dcda76d2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:58.649614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7a79-fe32-4d6b-aee5-b2d2dcda76d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:58.650008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7a79-fe32-4d6b-aee5-b2d2dcda76d2 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:58.651265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f7a79-fe32-4d6b-aee5-b2d2dcda76d2 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:58.653436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f7a79-fe32-4d6b-aee5-b2d2dcda76d2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:58.656435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 194/392] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:16:58 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:16:58.662540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f7a79-fe32-4d6b-aee5-b2d2dcda76d2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:58.676451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:58.775098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f7a79-fe32-4d6b-aee5-b2d2dcda76d2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:58.834688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56847a7f-f7be-4ef7-99da-b13f938d7e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:58.835595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847a7f-f7be-4ef7-99da-b13f938d7e6d None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:58.835882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847a7f-f7be-4ef7-99da-b13f938d7e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:58.836187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847a7f-f7be-4ef7-99da-b13f938d7e6d None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/groups/e56c98eb878a426f9e81b51b813841bb/roles/fd4cb9f5c4fb444498c049489198e975` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:58.838531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56847a7f-f7be-4ef7-99da-b13f938d7e6d None admin] RBAC: Authorizing `identity:create_grant(project_id=e273488503ac4eb5afd7c77c4bdd34c8, group_id=e56c98eb878a426f9e81b51b813841bb, role_id=fd4cb9f5c4fb444498c049489198e975)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:58.840771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56847a7f-f7be-4ef7-99da-b13f938d7e6d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:58.877808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1324b-6b9c-4dd5-8c5c-3d07d3328ddf None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:58.915550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e5aec-0de2-4617-950d-1e470296dcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:58.916724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5aec-0de2-4617-950d-1e470296dcfb None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:58.917151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5aec-0de2-4617-950d-1e470296dcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:58.917571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5aec-0de2-4617-950d-1e470296dcfb None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/groups/e56c98eb878a426f9e81b51b813841bb/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:58.920018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e5aec-0de2-4617-950d-1e470296dcfb None admin] RBAC: Authorizing `identity:create_grant(project_id=e273488503ac4eb5afd7c77c4bdd34c8, group_id=e56c98eb878a426f9e81b51b813841bb, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:58.927541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e5aec-0de2-4617-950d-1e470296dcfb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:58.966246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 195/393] 10.222.0.77 () {58 vars in 1442 bytes} [Thu Jun 16 17:16:58 2022] PUT /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/groups/e56c98eb878a426f9e81b51b813841bb/roles/fd4cb9f5c4fb444498c049489198e975 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:16:59.081909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 199/394] 10.222.0.77 () {58 vars in 1442 bytes} [Thu Jun 16 17:16:58 2022] PUT /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8/groups/e56c98eb878a426f9e81b51b813841bb/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:16:59.406050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c70e0e-f7ba-4123-944b-5d859bc9dbde None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:59.406531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c70e0e-f7ba-4123-944b-5d859bc9dbde None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:59.406531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c70e0e-f7ba-4123-944b-5d859bc9dbde None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:59.408000 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 196/395] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:59.414386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a6bd-1e0a-42e0-959d-6f8a26815026 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:59.414953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a6bd-1e0a-42e0-959d-6f8a26815026 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:59.415441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a6bd-1e0a-42e0-959d-6f8a26815026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:59.441085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4e52a6bd-1e0a-42e0-959d-6f8a26815026 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:59.442650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4e52a6bd-1e0a-42e0-959d-6f8a26815026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:59.487461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:59.540759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 200/396] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:59.577933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c70e0e-f7ba-4123-944b-5d859bc9dbde None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:59.688774 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:59.736888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c70e0e-f7ba-4123-944b-5d859bc9dbde None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:59.789719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66916d3-7314-487f-a2d0-8fd9cbd822b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:59.790537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66916d3-7314-487f-a2d0-8fd9cbd822b2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:59.790828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66916d3-7314-487f-a2d0-8fd9cbd822b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:59.791366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66916d3-7314-487f-a2d0-8fd9cbd822b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:59.793193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560674b-b5f7-40c7-a85c-949ad5c05fbf None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:59.793486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560674b-b5f7-40c7-a85c-949ad5c05fbf None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:59.793763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560674b-b5f7-40c7-a85c-949ad5c05fbf None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:59.795423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 201/397] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:16:59.800462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200f1b-7bf1-4cc5-b3ce-69a1ebcea027 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:59.800758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200f1b-7bf1-4cc5-b3ce-69a1ebcea027 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:59.801035 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200f1b-7bf1-4cc5-b3ce-69a1ebcea027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:59.806592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66916d3-7314-487f-a2d0-8fd9cbd822b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b66916d3-7314-487f-a2d0-8fd9cbd822b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:16:59.815296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:16:59.818916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:16:59.819725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 197/398] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:16:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:16:59.823715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66916d3-7314-487f-a2d0-8fd9cbd822b2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:16:59.849296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a4200f1b-7bf1-4cc5-b3ce-69a1ebcea027 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:16:59.850929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a4200f1b-7bf1-4cc5-b3ce-69a1ebcea027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:16:59.939840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66916d3-7314-487f-a2d0-8fd9cbd822b2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:16:59.972447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:16:59.977687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ea2e-b7f2-4b7f-8181-736f8d7d2b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:16:59.978468 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ea2e-b7f2-4b7f-8181-736f8d7d2b10 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:59.978747 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ea2e-b7f2-4b7f-8181-736f8d7d2b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:59.979019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ea2e-b7f2-4b7f-8181-736f8d7d2b10 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:59.979493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 202/399] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:16:59.979833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140ea2e-b7f2-4b7f-8181-736f8d7d2b10 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:16:59.980242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140ea2e-b7f2-4b7f-8181-736f8d7d2b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:16:59.981064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc13f5-9b55-445c-bf57-43757157589d None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:59.981359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc13f5-9b55-445c-bf57-43757157589d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:59.984202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc13f5-9b55-445c-bf57-43757157589d None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:59.984317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140ea2e-b7f2-4b7f-8181-736f8d7d2b10 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:16:59.984393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 203/400] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:16:59.988377 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd5ff5-2cf0-483d-8b47-94e43eca3c22 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:16:59.988890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd5ff5-2cf0-483d-8b47-94e43eca3c22 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:16:59.989371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd5ff5-2cf0-483d-8b47-94e43eca3c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:16:59.995759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 198/401] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:16:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:16:59.998044 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ea2e-b7f2-4b7f-8181-736f8d7d2b10 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.019389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-dfcd5ff5-2cf0-483d-8b47-94e43eca3c22 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:00.020986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-dfcd5ff5-2cf0-483d-8b47-94e43eca3c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:00.095648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 204/402] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:00.097119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd5ff5-2cf0-483d-8b47-94e43eca3c22 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.112405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ea2e-b7f2-4b7f-8181-736f8d7d2b10 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.127534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:00.149156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4982b-bb04-4919-88e2-9603e78e26a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:00.150031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4982b-bb04-4919-88e2-9603e78e26a7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.150312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4982b-bb04-4919-88e2-9603e78e26a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.150589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4982b-bb04-4919-88e2-9603e78e26a7 None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.151775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4982b-bb04-4919-88e2-9603e78e26a7 None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:00.154148 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4982b-bb04-4919-88e2-9603e78e26a7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:00.156009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 199/403] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:16:59 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:00.161661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4982b-bb04-4919-88e2-9603e78e26a7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.213140 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd5ff5-2cf0-483d-8b47-94e43eca3c22 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.217426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:00.254757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2089c46-db59-4138-b929-d9d24b5bb9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:00.255974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2089c46-db59-4138-b929-d9d24b5bb9ea None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.256507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2089c46-db59-4138-b929-d9d24b5bb9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.257011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2089c46-db59-4138-b929-d9d24b5bb9ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.259454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4982b-bb04-4919-88e2-9603e78e26a7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.270315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2089c46-db59-4138-b929-d9d24b5bb9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-f2089c46-db59-4138-b929-d9d24b5bb9ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:00.279948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:00.281021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:17:00.281814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:00.283933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 205/404] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:00.285095 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2089c46-db59-4138-b929-d9d24b5bb9ea None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.302916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7358109-eb79-480c-9514-dd26a1861a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:00.303973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7358109-eb79-480c-9514-dd26a1861a25 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.304204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7358109-eb79-480c-9514-dd26a1861a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.304548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7358109-eb79-480c-9514-dd26a1861a25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.315436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7358109-eb79-480c-9514-dd26a1861a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b7358109-eb79-480c-9514-dd26a1861a25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:00.323216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:00.324858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:00.325834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:00.327383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 200/405] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:00.328323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7358109-eb79-480c-9514-dd26a1861a25 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.399976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2089c46-db59-4138-b929-d9d24b5bb9ea None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.408278 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:00.432797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7358109-eb79-480c-9514-dd26a1861a25 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.439008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aaa65-3ac0-4951-9a84-c88dd76e1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:00.440152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aaa65-3ac0-4951-9a84-c88dd76e1444 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.440738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aaa65-3ac0-4951-9a84-c88dd76e1444 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.441159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aaa65-3ac0-4951-9a84-c88dd76e1444 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.442615 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015aaa65-3ac0-4951-9a84-c88dd76e1444 None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:00.444354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015aaa65-3ac0-4951-9a84-c88dd76e1444 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:00.446570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 206/406] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:17:00 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:00.447703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aaa65-3ac0-4951-9a84-c88dd76e1444 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.454113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:00.471250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e287b41-67d2-4c23-8357-0a70ef0ab41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:00.471873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e287b41-67d2-4c23-8357-0a70ef0ab41a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.472187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e287b41-67d2-4c23-8357-0a70ef0ab41a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.472469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e287b41-67d2-4c23-8357-0a70ef0ab41a None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.473325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e287b41-67d2-4c23-8357-0a70ef0ab41a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:00.473637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e287b41-67d2-4c23-8357-0a70ef0ab41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:00.475022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e287b41-67d2-4c23-8357-0a70ef0ab41a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:00.484449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 201/407] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:00.485234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e287b41-67d2-4c23-8357-0a70ef0ab41a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.565984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aaa65-3ac0-4951-9a84-c88dd76e1444 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.601804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724cd23-079c-4dee-a2cb-0cba61317eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:00.602481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724cd23-079c-4dee-a2cb-0cba61317eaa None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.602768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724cd23-079c-4dee-a2cb-0cba61317eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.603036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724cd23-079c-4dee-a2cb-0cba61317eaa None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.603786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724cd23-079c-4dee-a2cb-0cba61317eaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:00.604521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724cd23-079c-4dee-a2cb-0cba61317eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:00.606328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724cd23-079c-4dee-a2cb-0cba61317eaa None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:00.615413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 207/408] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:00.616336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724cd23-079c-4dee-a2cb-0cba61317eaa None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.623595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e287b41-67d2-4c23-8357-0a70ef0ab41a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.635401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:00.662966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a9272-73b2-4ff0-9e97-c6a30600d284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:00.664196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9272-73b2-4ff0-9e97-c6a30600d284 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.664489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9272-73b2-4ff0-9e97-c6a30600d284 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.664739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9272-73b2-4ff0-9e97-c6a30600d284 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/groups/e56c98eb878a426f9e81b51b813841bb/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.667574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a9272-73b2-4ff0-9e97-c6a30600d284 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eded0dcb0364e7ba479f0adbfff2ff1, group_id=e56c98eb878a426f9e81b51b813841bb, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:00.669623 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a9272-73b2-4ff0-9e97-c6a30600d284 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:00.722259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724cd23-079c-4dee-a2cb-0cba61317eaa None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.757251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b7f59-1d0d-4547-9175-5f533e885ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:00.758115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b7f59-1d0d-4547-9175-5f533e885ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.758399 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b7f59-1d0d-4547-9175-5f533e885ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.758680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b7f59-1d0d-4547-9175-5f533e885ec4 None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.759850 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b7f59-1d0d-4547-9175-5f533e885ec4 None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:00.761318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b7f59-1d0d-4547-9175-5f533e885ec4 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:00.763065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 208/409] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:17:00 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:00.763818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b7f59-1d0d-4547-9175-5f533e885ec4 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.803239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 202/410] 10.222.0.77 () {58 vars in 1442 bytes} [Thu Jun 16 17:17:00 2022] PUT /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/groups/e56c98eb878a426f9e81b51b813841bb/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:17:00.804958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a9272-73b2-4ff0-9e97-c6a30600d284 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:00.867818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:00.944912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a9272-73b2-4ff0-9e97-c6a30600d284 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.954400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:00.983504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b7f59-1d0d-4547-9175-5f533e885ec4 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:00.992385 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9dd06-7461-454f-9c1e-b612b8094944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:00.993590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9dd06-7461-454f-9c1e-b612b8094944 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:00.994093 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9dd06-7461-454f-9c1e-b612b8094944 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:00.994564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9dd06-7461-454f-9c1e-b612b8094944 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:00.997477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9dd06-7461-454f-9c1e-b612b8094944 None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:00.999328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9dd06-7461-454f-9c1e-b612b8094944 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:01.001311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 203/411] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:17:00 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:01.007509 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9dd06-7461-454f-9c1e-b612b8094944 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:01.027094 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e6c27-b0d7-4846-8d2e-e706a1ef288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:01.028027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e6c27-b0d7-4846-8d2e-e706a1ef288d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:01.028343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e6c27-b0d7-4846-8d2e-e706a1ef288d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:01.028619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e6c27-b0d7-4846-8d2e-e706a1ef288d None admin] PATH_INFO: `/v3/groups/fb7a1d95bc8e4d55aab83f9738345b21` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:01.029933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e6c27-b0d7-4846-8d2e-e706a1ef288d None admin] RBAC: Authorizing `identity:get_group(group_id=fb7a1d95bc8e4d55aab83f9738345b21)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:01.032121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e6c27-b0d7-4846-8d2e-e706a1ef288d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:01.035265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 209/412] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:17:00 2022] GET /identity/v3/groups/fb7a1d95bc8e4d55aab83f9738345b21 => generated 229 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:01.040445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e6c27-b0d7-4846-8d2e-e706a1ef288d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:01.173315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9dd06-7461-454f-9c1e-b612b8094944 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:01.196288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:01.211348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e6c27-b0d7-4846-8d2e-e706a1ef288d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:01.251736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae18aee-a1ba-48b9-ada4-fa2c87809a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:01.252698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae18aee-a1ba-48b9-ada4-fa2c87809a0c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:01.252980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae18aee-a1ba-48b9-ada4-fa2c87809a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:01.253257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae18aee-a1ba-48b9-ada4-fa2c87809a0c None admin] PATH_INFO: `/v3/projects/6c79ada12a254f71981d5de110c2a5b7` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:01.254739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae18aee-a1ba-48b9-ada4-fa2c87809a0c None admin] RBAC: Authorizing `identity:get_project(project_id=6c79ada12a254f71981d5de110c2a5b7)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:01.256263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae18aee-a1ba-48b9-ada4-fa2c87809a0c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:01.258317 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 210/413] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:17:01 2022] GET /identity/v3/projects/6c79ada12a254f71981d5de110c2a5b7 => generated 344 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:01.263095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ffe04-1872-47fd-9b48-4e08bf084857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:01.263923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ffe04-1872-47fd-9b48-4e08bf084857 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:01.264236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ffe04-1872-47fd-9b48-4e08bf084857 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:01.264512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ffe04-1872-47fd-9b48-4e08bf084857 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/groups/e56c98eb878a426f9e81b51b813841bb/roles/fd4cb9f5c4fb444498c049489198e975` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:01.266991 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ffe04-1872-47fd-9b48-4e08bf084857 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eded0dcb0364e7ba479f0adbfff2ff1, group_id=e56c98eb878a426f9e81b51b813841bb, role_id=fd4cb9f5c4fb444498c049489198e975)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:01.268497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ffe04-1872-47fd-9b48-4e08bf084857 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:01.269019 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae18aee-a1ba-48b9-ada4-fa2c87809a0c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:01.298456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:01.355763 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 204/414] 10.222.0.77 () {58 vars in 1442 bytes} [Thu Jun 16 17:17:01 2022] PUT /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1/groups/e56c98eb878a426f9e81b51b813841bb/roles/fd4cb9f5c4fb444498c049489198e975 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:17:01.403824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea55db-8c46-4bbd-b6d8-33982d22285d None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:01.404020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea55db-8c46-4bbd-b6d8-33982d22285d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:01.404357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea55db-8c46-4bbd-b6d8-33982d22285d None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:01.405923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 205/415] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:17:01.408490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae18aee-a1ba-48b9-ada4-fa2c87809a0c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:01.411608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafc95a-bb0f-4e0c-a669-a4f499d23b31 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:01.411894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafc95a-bb0f-4e0c-a669-a4f499d23b31 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:01.412207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafc95a-bb0f-4e0c-a669-a4f499d23b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:01.451070 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb48fa-d274-4d74-8818-21a3c0aef214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:01.452422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb48fa-d274-4d74-8818-21a3c0aef214 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:01.452880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb48fa-d274-4d74-8818-21a3c0aef214 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:01.453110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-eaafc95a-bb0f-4e0c-a669-a4f499d23b31 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:01.453867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb48fa-d274-4d74-8818-21a3c0aef214 None admin] PATH_INFO: `/v3/projects/6c79ada12a254f71981d5de110c2a5b7/groups/fb7a1d95bc8e4d55aab83f9738345b21/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:01.454318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-eaafc95a-bb0f-4e0c-a669-a4f499d23b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:01.456833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb48fa-d274-4d74-8818-21a3c0aef214 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c79ada12a254f71981d5de110c2a5b7, group_id=fb7a1d95bc8e4d55aab83f9738345b21, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:01.459598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb48fa-d274-4d74-8818-21a3c0aef214 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:01.544206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 206/416] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:01.560896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 211/417] 10.222.0.77 () {58 vars in 1442 bytes} [Thu Jun 16 17:17:01 2022] PUT /identity/v3/projects/6c79ada12a254f71981d5de110c2a5b7/groups/fb7a1d95bc8e4d55aab83f9738345b21/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:17:01.583164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafc95a-bb0f-4e0c-a669-a4f499d23b31 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:01.732391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:01.735795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafc95a-bb0f-4e0c-a669-a4f499d23b31 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:01.779428 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3da97-0cca-49df-b6bd-4f6443b389ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:01.780323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3da97-0cca-49df-b6bd-4f6443b389ee None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:01.780860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3da97-0cca-49df-b6bd-4f6443b389ee None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:01.781136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3da97-0cca-49df-b6bd-4f6443b389ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:01.794620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3da97-0cca-49df-b6bd-4f6443b389ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-46f3da97-0cca-49df-b6bd-4f6443b389ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:01.803183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:01.807165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:01.808173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 207/418] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:01.811001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb48fa-d274-4d74-8818-21a3c0aef214 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:01.842513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106450c2-f665-4bec-971c-8064e8d16d79 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:01.842834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106450c2-f665-4bec-971c-8064e8d16d79 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:01.843063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106450c2-f665-4bec-971c-8064e8d16d79 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:01.844463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 208/419] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:17:01.853107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebb4b0-31f3-46c7-8a05-8976b3679e26 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:01.853107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebb4b0-31f3-46c7-8a05-8976b3679e26 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:01.853107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebb4b0-31f3-46c7-8a05-8976b3679e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:01.881259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-52ebb4b0-31f3-46c7-8a05-8976b3679e26 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:01.882477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-52ebb4b0-31f3-46c7-8a05-8976b3679e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:01.914594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:01.935335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb48fa-d274-4d74-8818-21a3c0aef214 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:01.973275 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c7910-4f81-4a53-9c3a-7b478a298299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:01.973958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c7910-4f81-4a53-9c3a-7b478a298299 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:01.974245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c7910-4f81-4a53-9c3a-7b478a298299 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:01.974524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c7910-4f81-4a53-9c3a-7b478a298299 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:01.975306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c7910-4f81-4a53-9c3a-7b478a298299 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:01.975618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c7910-4f81-4a53-9c3a-7b478a298299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:01.977016 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c7910-4f81-4a53-9c3a-7b478a298299 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:01.998859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 212/420] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:02.003977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c7910-4f81-4a53-9c3a-7b478a298299 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:02.049663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 209/421] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:17:02.097187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebb4b0-31f3-46c7-8a05-8976b3679e26 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:02.175864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c7910-4f81-4a53-9c3a-7b478a298299 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:02.200527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:02.206690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebb4b0-31f3-46c7-8a05-8976b3679e26 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:02.251940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969b813-d118-4351-8718-081e36fbc84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:02.252164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e041838-d99c-49fa-8545-feb077e09c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:02.252823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b813-d118-4351-8718-081e36fbc84c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:02.253202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b813-d118-4351-8718-081e36fbc84c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:02.253576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b813-d118-4351-8718-081e36fbc84c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:02.267933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:02.268989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e041838-d99c-49fa-8545-feb077e09c4f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:02.269375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e041838-d99c-49fa-8545-feb077e09c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:02.269561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e041838-d99c-49fa-8545-feb077e09c4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:02.290186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e041838-d99c-49fa-8545-feb077e09c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2e041838-d99c-49fa-8545-feb077e09c4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:02.302325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:02.303196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:17:02.303993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:02.310490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 210/422] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:02.316382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e041838-d99c-49fa-8545-feb077e09c4f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:02.367931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969b813-d118-4351-8718-081e36fbc84c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:02.369731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969b813-d118-4351-8718-081e36fbc84c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:02.499492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e041838-d99c-49fa-8545-feb077e09c4f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:02.526213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 213/423] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:02.532352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969b813-d118-4351-8718-081e36fbc84c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:02.568418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155902dd-baf5-40c3-b304-9faa15698ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:02.569409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155902dd-baf5-40c3-b304-9faa15698ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:02.569905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155902dd-baf5-40c3-b304-9faa15698ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:02.570371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155902dd-baf5-40c3-b304-9faa15698ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:02.571324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155902dd-baf5-40c3-b304-9faa15698ff9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:02.571825 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155902dd-baf5-40c3-b304-9faa15698ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:02.573427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155902dd-baf5-40c3-b304-9faa15698ff9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:02.588410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 211/424] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:17:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:02.594599 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155902dd-baf5-40c3-b304-9faa15698ff9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:02.604937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:02.634059 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:02.673575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969b813-d118-4351-8718-081e36fbc84c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:02.745912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490bfe6-a7cd-427e-9d2b-7ec2881f3a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:02.746927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490bfe6-a7cd-427e-9d2b-7ec2881f3a48 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:02.747204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490bfe6-a7cd-427e-9d2b-7ec2881f3a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:02.748443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490bfe6-a7cd-427e-9d2b-7ec2881f3a48 None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:02.751262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490bfe6-a7cd-427e-9d2b-7ec2881f3a48 None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:02.752767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490bfe6-a7cd-427e-9d2b-7ec2881f3a48 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:02.754601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 214/425] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:17:02 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:02.765260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490bfe6-a7cd-427e-9d2b-7ec2881f3a48 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:02.784701 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155902dd-baf5-40c3-b304-9faa15698ff9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:02.836189 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50695c5a-2bda-4ac1-bf07-98ebbfc24ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:02.838658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50695c5a-2bda-4ac1-bf07-98ebbfc24ecb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:02.838954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50695c5a-2bda-4ac1-bf07-98ebbfc24ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:02.839235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50695c5a-2bda-4ac1-bf07-98ebbfc24ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:02.962586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50695c5a-2bda-4ac1-bf07-98ebbfc24ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:02.964047 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50695c5a-2bda-4ac1-bf07-98ebbfc24ecb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:02.968032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490bfe6-a7cd-427e-9d2b-7ec2881f3a48 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:02.992455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:02.998250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:03.042174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6259025-2a93-4adf-96f9-93c744bfc8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:03.043717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6259025-2a93-4adf-96f9-93c744bfc8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.044089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6259025-2a93-4adf-96f9-93c744bfc8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.044392 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6259025-2a93-4adf-96f9-93c744bfc8a8 None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.046728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6259025-2a93-4adf-96f9-93c744bfc8a8 None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:03.048219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6259025-2a93-4adf-96f9-93c744bfc8a8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:03.051038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 215/426] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:17:02 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:03.055848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6259025-2a93-4adf-96f9-93c744bfc8a8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:03.151146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 212/427] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:03.161357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50695c5a-2bda-4ac1-bf07-98ebbfc24ecb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:03.249842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6259025-2a93-4adf-96f9-93c744bfc8a8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:03.315226 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50695c5a-2bda-4ac1-bf07-98ebbfc24ecb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:03.324123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceffb2d-0b26-4e37-a4c9-3e964fd27bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:03.324862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceffb2d-0b26-4e37-a4c9-3e964fd27bcb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.325150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceffb2d-0b26-4e37-a4c9-3e964fd27bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.325425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceffb2d-0b26-4e37-a4c9-3e964fd27bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.326268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceffb2d-0b26-4e37-a4c9-3e964fd27bcb None admin] RBAC: Adding query filter params (group.id=e56c98eb878a426f9e81b51b813841bb, role.id=fd4cb9f5c4fb444498c049489198e975, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:03.326764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceffb2d-0b26-4e37-a4c9-3e964fd27bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:03.328111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceffb2d-0b26-4e37-a4c9-3e964fd27bcb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:03.338263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:03.343486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 216/428] 10.222.0.77 () {56 vars in 1376 bytes} [Thu Jun 16 17:17:03 2022] GET /identity/v3/role_assignments?group.id=e56c98eb878a426f9e81b51b813841bb&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=fd4cb9f5c4fb444498c049489198e975 => generated 611 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:03.366805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0392061-28bc-4a5b-8900-ce48e02d83fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:03.368040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392061-28bc-4a5b-8900-ce48e02d83fb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.368545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392061-28bc-4a5b-8900-ce48e02d83fb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.369017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392061-28bc-4a5b-8900-ce48e02d83fb None admin] PATH_INFO: `/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.372963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0392061-28bc-4a5b-8900-ce48e02d83fb None admin] RBAC: Authorizing `identity:get_project(project_id=e273488503ac4eb5afd7c77c4bdd34c8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:03.374685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0392061-28bc-4a5b-8900-ce48e02d83fb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:03.377028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 213/429] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:17:03 2022] GET /identity/v3/projects/e273488503ac4eb5afd7c77c4bdd34c8 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:03.382533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceffb2d-0b26-4e37-a4c9-3e964fd27bcb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:03.473050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:03.521446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea660c-ef7a-4206-a9dc-741581de52b9 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.522423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea660c-ef7a-4206-a9dc-741581de52b9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.522953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea660c-ef7a-4206-a9dc-741581de52b9 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.525213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 214/430] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:03.531325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cafaa3-f747-4ebf-827f-6b62a1eabdf0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.531927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cafaa3-f747-4ebf-827f-6b62a1eabdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.532457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cafaa3-f747-4ebf-827f-6b62a1eabdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.565647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e3cafaa3-f747-4ebf-827f-6b62a1eabdf0 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:03.567405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e3cafaa3-f747-4ebf-827f-6b62a1eabdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:03.569553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceffb2d-0b26-4e37-a4c9-3e964fd27bcb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:03.642114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba1b31-5294-4c3d-9660-94ea6d3f0d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:03.642867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba1b31-5294-4c3d-9660-94ea6d3f0d98 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.643155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba1b31-5294-4c3d-9660-94ea6d3f0d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.643430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba1b31-5294-4c3d-9660-94ea6d3f0d98 None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.644689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba1b31-5294-4c3d-9660-94ea6d3f0d98 None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:03.646243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba1b31-5294-4c3d-9660-94ea6d3f0d98 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:03.648340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 217/431] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:17:03 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:03.654405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba1b31-5294-4c3d-9660-94ea6d3f0d98 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:03.679774 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 215/432] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:03.705281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cafaa3-f747-4ebf-827f-6b62a1eabdf0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:03.777506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba1b31-5294-4c3d-9660-94ea6d3f0d98 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:03.789359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:03.821451 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d80350-ff9d-4552-9c08-913ba078df50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:03.823475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d80350-ff9d-4552-9c08-913ba078df50 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.823680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d80350-ff9d-4552-9c08-913ba078df50 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.823929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d80350-ff9d-4552-9c08-913ba078df50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.825636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d80350-ff9d-4552-9c08-913ba078df50 None admin] RBAC: Adding query filter params (group.id=e56c98eb878a426f9e81b51b813841bb, role.id=14542129036041fa85f7c5223487670d, scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:03.825863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d80350-ff9d-4552-9c08-913ba078df50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:03.827307 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d80350-ff9d-4552-9c08-913ba078df50 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:03.833670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 218/433] 10.222.0.77 () {56 vars in 1376 bytes} [Thu Jun 16 17:17:03 2022] GET /identity/v3/role_assignments?group.id=e56c98eb878a426f9e81b51b813841bb&scope.project.id=e273488503ac4eb5afd7c77c4bdd34c8&role.id=14542129036041fa85f7c5223487670d => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:03.843634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cafaa3-f747-4ebf-827f-6b62a1eabdf0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:03.856916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:03.888210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09168ac6-188f-48a5-a233-54dca418db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:03.889415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168ac6-188f-48a5-a233-54dca418db88 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.890131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168ac6-188f-48a5-a233-54dca418db88 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.890617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168ac6-188f-48a5-a233-54dca418db88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.904853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09168ac6-188f-48a5-a233-54dca418db88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-09168ac6-188f-48a5-a233-54dca418db88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:03.913781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:03.914781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 17:17:03.915574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:03.918391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 216/434] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:03.924886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d80350-ff9d-4552-9c08-913ba078df50 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:03.984638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e0fd8-faa5-49f9-8fee-7b9f1fd7005a None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.985294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e0fd8-faa5-49f9-8fee-7b9f1fd7005a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.985770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e0fd8-faa5-49f9-8fee-7b9f1fd7005a None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:03.987649 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 217/435] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:17:03.993562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd00f43-2a99-4785-87d5-0bb23872b852 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:03.994179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd00f43-2a99-4785-87d5-0bb23872b852 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:03.994659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd00f43-2a99-4785-87d5-0bb23872b852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.013945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fbd00f43-2a99-4785-87d5-0bb23872b852 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:04.015796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fbd00f43-2a99-4785-87d5-0bb23872b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:04.046041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d80350-ff9d-4552-9c08-913ba078df50 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:04.087628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963be47c-d84c-4a83-8867-f7578705569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:04.088340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be47c-d84c-4a83-8867-f7578705569b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:04.088624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be47c-d84c-4a83-8867-f7578705569b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:04.088900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be47c-d84c-4a83-8867-f7578705569b None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.091361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963be47c-d84c-4a83-8867-f7578705569b None admin] RBAC: Adding query filter params (name=member) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:04.091361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963be47c-d84c-4a83-8867-f7578705569b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:04.091961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963be47c-d84c-4a83-8867-f7578705569b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:04.100332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 218/436] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:17:04.104721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 219/437] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:17:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:04.113632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd00f43-2a99-4785-87d5-0bb23872b852 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:04.125962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963be47c-d84c-4a83-8867-f7578705569b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:04.173920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:04.238793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:04.241828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd00f43-2a99-4785-87d5-0bb23872b852 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:04.258237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963be47c-d84c-4a83-8867-f7578705569b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:04.284053 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07e358-8a5c-41a0-8038-271bb8e26443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:04.284820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07e358-8a5c-41a0-8038-271bb8e26443 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:04.285108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07e358-8a5c-41a0-8038-271bb8e26443 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:04.285390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07e358-8a5c-41a0-8038-271bb8e26443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.301483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ae0de-8d68-4569-aa2f-a321a11ca4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:04.302229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae0de-8d68-4569-aa2f-a321a11ca4ab None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:04.302516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae0de-8d68-4569-aa2f-a321a11ca4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:04.302800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae0de-8d68-4569-aa2f-a321a11ca4ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.315064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ae0de-8d68-4569-aa2f-a321a11ca4ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-c83ae0de-8d68-4569-aa2f-a321a11ca4ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:04.323492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:04.324390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 220/438] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:04.331286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70833300-2697-4eb4-9ed1-dffae6b5252d None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:04.331998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70833300-2697-4eb4-9ed1-dffae6b5252d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:04.331998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70833300-2697-4eb4-9ed1-dffae6b5252d None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.331998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 221/439] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:04.333269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70833300-2697-4eb4-9ed1-dffae6b5252d None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:04.370245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07e358-8a5c-41a0-8038-271bb8e26443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:04.372322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07e358-8a5c-41a0-8038-271bb8e26443 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:04.448183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:04.455804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70833300-2697-4eb4-9ed1-dffae6b5252d None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:04.488961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:04.490574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569dde-be4d-4aaf-9b85-3f5893a9d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:04.491242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569dde-be4d-4aaf-9b85-3f5893a9d263 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:04.491523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569dde-be4d-4aaf-9b85-3f5893a9d263 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:04.491795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569dde-be4d-4aaf-9b85-3f5893a9d263 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.492504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 219/440] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:04.492633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee569dde-be4d-4aaf-9b85-3f5893a9d263 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:04.492853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee569dde-be4d-4aaf-9b85-3f5893a9d263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:04.493830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68e32-3b3e-438f-bb69-75b78c8ee0e0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:04.494162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68e32-3b3e-438f-bb69-75b78c8ee0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:04.494265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee569dde-be4d-4aaf-9b85-3f5893a9d263 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:04.494440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68e32-3b3e-438f-bb69-75b78c8ee0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.505069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 222/441] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:04.505866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569dde-be4d-4aaf-9b85-3f5893a9d263 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:04.512724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-dfe68e32-3b3e-438f-bb69-75b78c8ee0e0 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:04.513917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-dfe68e32-3b3e-438f-bb69-75b78c8ee0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:04.588180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 220/442] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:04.589028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe68e32-3b3e-438f-bb69-75b78c8ee0e0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:04.612211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569dde-be4d-4aaf-9b85-3f5893a9d263 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:04.647083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90813add-c0bc-4763-8ff8-88ea6cc6d1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:04.647947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90813add-c0bc-4763-8ff8-88ea6cc6d1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:04.648264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90813add-c0bc-4763-8ff8-88ea6cc6d1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:04.648539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90813add-c0bc-4763-8ff8-88ea6cc6d1e4 None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.649724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90813add-c0bc-4763-8ff8-88ea6cc6d1e4 None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:04.651165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90813add-c0bc-4763-8ff8-88ea6cc6d1e4 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:04.653503 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 223/443] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:17:04 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:04.654254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90813add-c0bc-4763-8ff8-88ea6cc6d1e4 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:04.683064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:04.702538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe68e32-3b3e-438f-bb69-75b78c8ee0e0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:04.732401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:04.738382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8077-1995-4255-9feb-e2700eefaa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:04.739070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8077-1995-4255-9feb-e2700eefaa2f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:04.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8077-1995-4255-9feb-e2700eefaa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:04.739639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8077-1995-4255-9feb-e2700eefaa2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.758963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90813add-c0bc-4763-8ff8-88ea6cc6d1e4 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:04.794304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b910658-5e3f-4bcd-b893-916d8738e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:04.795101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b910658-5e3f-4bcd-b893-916d8738e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:04.795384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b910658-5e3f-4bcd-b893-916d8738e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:04.795661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b910658-5e3f-4bcd-b893-916d8738e9f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.805815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b910658-5e3f-4bcd-b893-916d8738e9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:04.808893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc8077-1995-4255-9feb-e2700eefaa2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:04.810383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc8077-1995-4255-9feb-e2700eefaa2f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-9b910658-5e3f-4bcd-b893-916d8738e9f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:04.813720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:04.814647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:04.815510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 224/444] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:04.816206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b910658-5e3f-4bcd-b893-916d8738e9f4 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:04.903223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:04.911415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 221/445] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:04.912275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8077-1995-4255-9feb-e2700eefaa2f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:04.918573 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b910658-5e3f-4bcd-b893-916d8738e9f4 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:04.942979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:04.952617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c87bf-24f5-421f-87cf-1ac2efe8eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:04.953485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c87bf-24f5-421f-87cf-1ac2efe8eade None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:04.953768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c87bf-24f5-421f-87cf-1ac2efe8eade None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:04.954045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c87bf-24f5-421f-87cf-1ac2efe8eade None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:04.955245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c87bf-24f5-421f-87cf-1ac2efe8eade None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:04.956722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c87bf-24f5-421f-87cf-1ac2efe8eade None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:04.963863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 225/446] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:17:04 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:04.963863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c87bf-24f5-421f-87cf-1ac2efe8eade None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:05.013852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8077-1995-4255-9feb-e2700eefaa2f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:05.046938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1113b25-a1e1-4c8b-a9fc-d5d1d694eb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:05.047602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1113b25-a1e1-4c8b-a9fc-d5d1d694eb6c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.047881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1113b25-a1e1-4c8b-a9fc-d5d1d694eb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.048181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1113b25-a1e1-4c8b-a9fc-d5d1d694eb6c None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:05.048913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1113b25-a1e1-4c8b-a9fc-d5d1d694eb6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:05.049212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1113b25-a1e1-4c8b-a9fc-d5d1d694eb6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:05.050846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1113b25-a1e1-4c8b-a9fc-d5d1d694eb6c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:05.058996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 222/447] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:05.060038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1113b25-a1e1-4c8b-a9fc-d5d1d694eb6c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:05.065864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c87bf-24f5-421f-87cf-1ac2efe8eade None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:05.099405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec70d-e48f-43be-9c55-09713b096e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:05.100298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec70d-e48f-43be-9c55-09713b096e6d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.100581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec70d-e48f-43be-9c55-09713b096e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.100854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec70d-e48f-43be-9c55-09713b096e6d None admin] PATH_INFO: `/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:05.102036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ec70d-e48f-43be-9c55-09713b096e6d None admin] RBAC: Authorizing `identity:get_project(project_id=7eded0dcb0364e7ba479f0adbfff2ff1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:05.103461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ec70d-e48f-43be-9c55-09713b096e6d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:05.105190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 226/448] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:17:04 2022] GET /identity/v3/projects/7eded0dcb0364e7ba479f0adbfff2ff1 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:05.106244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec70d-e48f-43be-9c55-09713b096e6d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:05.135889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:05.152777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:05.161841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1113b25-a1e1-4c8b-a9fc-d5d1d694eb6c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:05.194706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f84f0-2274-44c3-9047-76d7a46e4a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:05.195410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f84f0-2274-44c3-9047-76d7a46e4a53 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.195695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f84f0-2274-44c3-9047-76d7a46e4a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.195976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f84f0-2274-44c3-9047-76d7a46e4a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:05.196824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f84f0-2274-44c3-9047-76d7a46e4a53 None admin] RBAC: Adding query filter params (group.id=e56c98eb878a426f9e81b51b813841bb, role.id=14542129036041fa85f7c5223487670d, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:05.210033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f84f0-2274-44c3-9047-76d7a46e4a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:05.210033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f84f0-2274-44c3-9047-76d7a46e4a53 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:05.210033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 223/449] 10.222.0.77 () {56 vars in 1376 bytes} [Thu Jun 16 17:17:05 2022] GET /identity/v3/role_assignments?group.id=e56c98eb878a426f9e81b51b813841bb&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=14542129036041fa85f7c5223487670d => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:05.210033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f84f0-2274-44c3-9047-76d7a46e4a53 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:05.214504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec70d-e48f-43be-9c55-09713b096e6d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:05.254028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a531e3-c829-4bdf-b361-bb9f407cfdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:05.254697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a531e3-c829-4bdf-b361-bb9f407cfdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.255219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a531e3-c829-4bdf-b361-bb9f407cfdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.255325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a531e3-c829-4bdf-b361-bb9f407cfdf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:05.319726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f84f0-2274-44c3-9047-76d7a46e4a53 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:05.337594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a531e3-c829-4bdf-b361-bb9f407cfdf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:05.339344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a531e3-c829-4bdf-b361-bb9f407cfdf3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:05.357138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950760d5-e5bd-4065-b30b-8b763b7db4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:05.358030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950760d5-e5bd-4065-b30b-8b763b7db4ca None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.358317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950760d5-e5bd-4065-b30b-8b763b7db4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.358595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950760d5-e5bd-4065-b30b-8b763b7db4ca None admin] PATH_INFO: `/v3/groups/e56c98eb878a426f9e81b51b813841bb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:05.359837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950760d5-e5bd-4065-b30b-8b763b7db4ca None admin] RBAC: Authorizing `identity:get_group(group_id=e56c98eb878a426f9e81b51b813841bb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:05.361341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950760d5-e5bd-4065-b30b-8b763b7db4ca None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:05.363014 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 224/450] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:17:05 2022] GET /identity/v3/groups/e56c98eb878a426f9e81b51b813841bb => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:05.367920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:05.368975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950760d5-e5bd-4065-b30b-8b763b7db4ca None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:05.402415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:05.458550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 227/451] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:05.464451 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a531e3-c829-4bdf-b361-bb9f407cfdf3 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:05.487637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950760d5-e5bd-4065-b30b-8b763b7db4ca None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:05.527986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf8f30-df6f-497e-afbd-9945c074bb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:05.528704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8f30-df6f-497e-afbd-9945c074bb5f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.528986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8f30-df6f-497e-afbd-9945c074bb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.529304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8f30-df6f-497e-afbd-9945c074bb5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:05.530138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf8f30-df6f-497e-afbd-9945c074bb5f None admin] RBAC: Adding query filter params (group.id=e56c98eb878a426f9e81b51b813841bb, role.id=fd4cb9f5c4fb444498c049489198e975, scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:05.530452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf8f30-df6f-497e-afbd-9945c074bb5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:05.531908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf8f30-df6f-497e-afbd-9945c074bb5f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:05.538087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 225/452] 10.222.0.77 () {56 vars in 1376 bytes} [Thu Jun 16 17:17:05 2022] GET /identity/v3/role_assignments?group.id=e56c98eb878a426f9e81b51b813841bb&scope.project.id=7eded0dcb0364e7ba479f0adbfff2ff1&role.id=fd4cb9f5c4fb444498c049489198e975 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:05.589173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a531e3-c829-4bdf-b361-bb9f407cfdf3 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:05.616449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:05.630769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd02db5-475a-43ab-9b64-4a082c03a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:05.636939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd02db5-475a-43ab-9b64-4a082c03a031 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.636939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd02db5-475a-43ab-9b64-4a082c03a031 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.636939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd02db5-475a-43ab-9b64-4a082c03a031 None admin] PATH_INFO: `/v3/projects/6c79ada12a254f71981d5de110c2a5b7` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:05.636939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd02db5-475a-43ab-9b64-4a082c03a031 None admin] RBAC: Authorizing `identity:get_project(project_id=6c79ada12a254f71981d5de110c2a5b7)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:05.636939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd02db5-475a-43ab-9b64-4a082c03a031 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:05.637550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 228/453] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:17:05 2022] GET /identity/v3/projects/6c79ada12a254f71981d5de110c2a5b7 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:05.643491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf8f30-df6f-497e-afbd-9945c074bb5f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:05.740672 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:05.753427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf8f30-df6f-497e-afbd-9945c074bb5f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:05.789612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c4ba9-96be-495a-a40a-9f351358b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:05.790491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c4ba9-96be-495a-a40a-9f351358b313 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.790772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c4ba9-96be-495a-a40a-9f351358b313 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.791048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c4ba9-96be-495a-a40a-9f351358b313 None admin] PATH_INFO: `/v3/groups/fb7a1d95bc8e4d55aab83f9738345b21` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:05.792262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c4ba9-96be-495a-a40a-9f351358b313 None admin] RBAC: Authorizing `identity:get_group(group_id=fb7a1d95bc8e4d55aab83f9738345b21)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:05.795029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c4ba9-96be-495a-a40a-9f351358b313 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:05.796726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 226/454] 10.222.0.77 () {56 vars in 1180 bytes} [Thu Jun 16 17:17:05 2022] GET /identity/v3/groups/fb7a1d95bc8e4d55aab83f9738345b21 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:05.802998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd02db5-475a-43ab-9b64-4a082c03a031 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:05.909409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd02db5-475a-43ab-9b64-4a082c03a031 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:05.943214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432c032-da26-40fa-929f-5097e21fbe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:05.943873 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432c032-da26-40fa-929f-5097e21fbe38 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:05.944196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432c032-da26-40fa-929f-5097e21fbe38 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:05.944478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432c032-da26-40fa-929f-5097e21fbe38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:05.945298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432c032-da26-40fa-929f-5097e21fbe38 None admin] RBAC: Adding query filter params (group.id=fb7a1d95bc8e4d55aab83f9738345b21, role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=6c79ada12a254f71981d5de110c2a5b7) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:05.945615 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432c032-da26-40fa-929f-5097e21fbe38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:05.947044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432c032-da26-40fa-929f-5097e21fbe38 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:05.953420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 229/455] 10.222.0.77 () {56 vars in 1376 bytes} [Thu Jun 16 17:17:05 2022] GET /identity/v3/role_assignments?group.id=fb7a1d95bc8e4d55aab83f9738345b21&scope.project.id=6c79ada12a254f71981d5de110c2a5b7&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:08.674947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fb76-1f9c-44b7-9cf2-16e4baf34f09 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:08.675485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fb76-1f9c-44b7-9cf2-16e4baf34f09 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:08.675485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fb76-1f9c-44b7-9cf2-16e4baf34f09 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:08.677193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 227/456] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:08.682669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2536413-6d6e-48f8-9e48-0abbc04fa9a8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:08.684144 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2536413-6d6e-48f8-9e48-0abbc04fa9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:08.684744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2536413-6d6e-48f8-9e48-0abbc04fa9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:08.709085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d2536413-6d6e-48f8-9e48-0abbc04fa9a8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:08.710645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d2536413-6d6e-48f8-9e48-0abbc04fa9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:08.767716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:08.794123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 230/457] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:08.821028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11027195-815c-49a4-a54d-9a7aee8f7f16 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:08.821306 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11027195-815c-49a4-a54d-9a7aee8f7f16 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:08.821748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11027195-815c-49a4-a54d-9a7aee8f7f16 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:08.823384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 228/458] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:08.829936 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4990b1-0bbc-4080-8328-d5d7a6b4012d None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:08.830414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4990b1-0bbc-4080-8328-d5d7a6b4012d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:08.830858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4990b1-0bbc-4080-8328-d5d7a6b4012d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:08.834314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11027195-815c-49a4-a54d-9a7aee8f7f16 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:08.876859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6f4990b1-0bbc-4080-8328-d5d7a6b4012d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:08.878310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6f4990b1-0bbc-4080-8328-d5d7a6b4012d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:08.945621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11027195-815c-49a4-a54d-9a7aee8f7f16 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:08.986009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0d18-e675-4c03-acf5-18fe94846fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:08.987184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0d18-e675-4c03-acf5-18fe94846fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:08.987690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0d18-e675-4c03-acf5-18fe94846fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:08.988201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0d18-e675-4c03-acf5-18fe94846fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.000846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de0d18-e675-4c03-acf5-18fe94846fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:09.002637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de0d18-e675-4c03-acf5-18fe94846fa3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-08de0d18-e675-4c03-acf5-18fe94846fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:09.022583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:09.023463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:09.024341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:09.024341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:09.024341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:09.024341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:09.026611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 229/459] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:09.036103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0d18-e675-4c03-acf5-18fe94846fa3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:09.046115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 231/460] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:09.046730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:09.048773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d040-6bf6-44d5-965d-cb7087d32ec0 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.049071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d040-6bf6-44d5-965d-cb7087d32ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.049351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d040-6bf6-44d5-965d-cb7087d32ec0 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.050630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 232/461] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:09.055993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b60c28-fd92-4ffd-a810-1dc40d4ef86f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.056350 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b60c28-fd92-4ffd-a810-1dc40d4ef86f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.057843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b60c28-fd92-4ffd-a810-1dc40d4ef86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.075340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-c2b60c28-fd92-4ffd-a810-1dc40d4ef86f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:09.076888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c2b60c28-fd92-4ffd-a810-1dc40d4ef86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:09.162512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0d18-e675-4c03-acf5-18fe94846fa3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:09.172156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 233/462] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:17:09.173215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b60c28-fd92-4ffd-a810-1dc40d4ef86f None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:09.226045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6670-8f25-42f7-a279-2a809bdf17c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:09.226737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6670-8f25-42f7-a279-2a809bdf17c7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.227076 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6670-8f25-42f7-a279-2a809bdf17c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.227361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6670-8f25-42f7-a279-2a809bdf17c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.228106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef6670-8f25-42f7-a279-2a809bdf17c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:09.228425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef6670-8f25-42f7-a279-2a809bdf17c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:09.231363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef6670-8f25-42f7-a279-2a809bdf17c7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:09.243374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:09.248607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 230/463] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:09.249542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6670-8f25-42f7-a279-2a809bdf17c7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:09.301055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b60c28-fd92-4ffd-a810-1dc40d4ef86f None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:09.326733 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:09.337654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17913c-fc13-4909-855f-cb15729238b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:09.338794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17913c-fc13-4909-855f-cb15729238b9 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.338794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17913c-fc13-4909-855f-cb15729238b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.339103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17913c-fc13-4909-855f-cb15729238b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.350885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17913c-fc13-4909-855f-cb15729238b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:09.352365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17913c-fc13-4909-855f-cb15729238b9 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:09.368519 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6670-8f25-42f7-a279-2a809bdf17c7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-dd17913c-fc13-4909-855f-cb15729238b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:09.371842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:09.372916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:09.376884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:09.376884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:09.376884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:09.376884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:09.376884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 234/464] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:09.376884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17913c-fc13-4909-855f-cb15729238b9 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:09.415699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12515688-f06e-4f7e-93b9-1d84cfa0e1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:09.416476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515688-f06e-4f7e-93b9-1d84cfa0e1af None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.416761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515688-f06e-4f7e-93b9-1d84cfa0e1af None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.417037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515688-f06e-4f7e-93b9-1d84cfa0e1af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.429670 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12515688-f06e-4f7e-93b9-1d84cfa0e1af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:09.431162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12515688-f06e-4f7e-93b9-1d84cfa0e1af None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-12515688-f06e-4f7e-93b9-1d84cfa0e1af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:09.451587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:09.452531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:09.453377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:09.453377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:09.453377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:09.453377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:09.453377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 231/465] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:09.454167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f25184-76f4-4b22-916f-e4ba13208bf0 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.454452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f25184-76f4-4b22-916f-e4ba13208bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.454729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f25184-76f4-4b22-916f-e4ba13208bf0 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.459774 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 232/466] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:09.459774 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f25184-76f4-4b22-916f-e4ba13208bf0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:09.484765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:09.491157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17913c-fc13-4909-855f-cb15729238b9 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:09.533278 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d6713-1be9-4795-aba8-44e240d853ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:09.533950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d6713-1be9-4795-aba8-44e240d853ca None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.534230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d6713-1be9-4795-aba8-44e240d853ca None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.534505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d6713-1be9-4795-aba8-44e240d853ca None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.535200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d6713-1be9-4795-aba8-44e240d853ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:09.536728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d6713-1be9-4795-aba8-44e240d853ca None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:09.570337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f25184-76f4-4b22-916f-e4ba13208bf0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:09.593416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:09.607436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde90ec1-7e89-4e8c-9bf4-2d25b69e29ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:09.608172 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde90ec1-7e89-4e8c-9bf4-2d25b69e29ae None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.608455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde90ec1-7e89-4e8c-9bf4-2d25b69e29ae None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.608726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde90ec1-7e89-4e8c-9bf4-2d25b69e29ae None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.609433 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde90ec1-7e89-4e8c-9bf4-2d25b69e29ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:09.609762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde90ec1-7e89-4e8c-9bf4-2d25b69e29ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:09.611132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde90ec1-7e89-4e8c-9bf4-2d25b69e29ae None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:09.622273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 233/467] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:09.622973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde90ec1-7e89-4e8c-9bf4-2d25b69e29ae None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:09.666652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 235/468] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:17:09 2022] POST /identity/v3/users => generated 248 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:09.673692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83644d-0aac-40fd-bc75-cff77c62e01c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.685665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83644d-0aac-40fd-bc75-cff77c62e01c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.685665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83644d-0aac-40fd-bc75-cff77c62e01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.713136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-af83644d-0aac-40fd-bc75-cff77c62e01c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:09.715362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-af83644d-0aac-40fd-bc75-cff77c62e01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:09.737987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde90ec1-7e89-4e8c-9bf4-2d25b69e29ae None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:09.789982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1ff7-a4f1-4ce8-b0d6-a3082a806391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:09.790878 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1ff7-a4f1-4ce8-b0d6-a3082a806391 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:09.791992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1ff7-a4f1-4ce8-b0d6-a3082a806391 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:09.792431 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1ff7-a4f1-4ce8-b0d6-a3082a806391 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:09.794033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1ff7-a4f1-4ce8-b0d6-a3082a806391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:09.794357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1ff7-a4f1-4ce8-b0d6-a3082a806391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:09.796355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1ff7-a4f1-4ce8-b0d6-a3082a806391 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:09.812881 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 236/469] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:09.814248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83644d-0aac-40fd-bc75-cff77c62e01c None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:09.819137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 234/470] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:09.821681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1ff7-a4f1-4ce8-b0d6-a3082a806391 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:09.903864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:09.953939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:09.970262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1ff7-a4f1-4ce8-b0d6-a3082a806391 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:09.973710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83644d-0aac-40fd-bc75-cff77c62e01c None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:10.005842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b06a8-99b4-4652-930b-7cdfe059b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:10.006516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b06a8-99b4-4652-930b-7cdfe059b762 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:10.006823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b06a8-99b4-4652-930b-7cdfe059b762 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:10.007067 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b06a8-99b4-4652-930b-7cdfe059b762 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:10.007772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b06a8-99b4-4652-930b-7cdfe059b762 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:10.009225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b06a8-99b4-4652-930b-7cdfe059b762 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:10.013686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd550864-9590-43e5-aa7b-babfd800a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:10.013686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd550864-9590-43e5-aa7b-babfd800a736 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:10.013686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd550864-9590-43e5-aa7b-babfd800a736 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:10.013686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd550864-9590-43e5-aa7b-babfd800a736 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:10.014045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd550864-9590-43e5-aa7b-babfd800a736 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:10.015165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd550864-9590-43e5-aa7b-babfd800a736 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:10.119964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 235/471] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:17:09 2022] POST /identity/v3/users => generated 248 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:10.129243 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b06a8-99b4-4652-930b-7cdfe059b762 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:10.151631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 237/472] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:17:09 2022] POST /identity/v3/users => generated 246 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:10.154995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c310f-9980-4122-85fd-a16c4b9e3f25 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:10.162799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c310f-9980-4122-85fd-a16c4b9e3f25 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:10.162799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c310f-9980-4122-85fd-a16c4b9e3f25 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:10.162799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 238/473] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:10.164279 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58b75-1942-4a44-98f0-576a3dd68814 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:10.164810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58b75-1942-4a44-98f0-576a3dd68814 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:10.165298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58b75-1942-4a44-98f0-576a3dd68814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:10.190481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-5cf58b75-1942-4a44-98f0-576a3dd68814 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:10.192329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5cf58b75-1942-4a44-98f0-576a3dd68814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:10.260784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:10.268910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b06a8-99b4-4652-930b-7cdfe059b762 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:10.310124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 239/474] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:10.328912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eab5f-581b-4723-aa24-7d32974b5681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:10.330212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eab5f-581b-4723-aa24-7d32974b5681 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:10.330703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eab5f-581b-4723-aa24-7d32974b5681 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:10.331263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eab5f-581b-4723-aa24-7d32974b5681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:10.338358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf58b75-1942-4a44-98f0-576a3dd68814 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:10.367774 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eab5f-581b-4723-aa24-7d32974b5681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:10.372036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eab5f-581b-4723-aa24-7d32974b5681 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-854eab5f-581b-4723-aa24-7d32974b5681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:10.392577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:10.393492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:10.394328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:10.394328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:10.394328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:10.394328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:10.396873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 236/475] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:10.403405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eab5f-581b-4723-aa24-7d32974b5681 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:10.454630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:10.499686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf58b75-1942-4a44-98f0-576a3dd68814 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:10.537537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eab5f-581b-4723-aa24-7d32974b5681 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:10.548061 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec7e3e-3c6b-49b4-9128-a5c76ea04348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:10.549011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec7e3e-3c6b-49b4-9128-a5c76ea04348 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:10.549445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec7e3e-3c6b-49b4-9128-a5c76ea04348 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:10.549869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec7e3e-3c6b-49b4-9128-a5c76ea04348 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:10.551309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec7e3e-3c6b-49b4-9128-a5c76ea04348 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:10.553523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec7e3e-3c6b-49b4-9128-a5c76ea04348 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:10.580683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac51c7-2493-4c54-9c9c-2164ca941a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:10.581360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac51c7-2493-4c54-9c9c-2164ca941a10 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:10.581643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac51c7-2493-4c54-9c9c-2164ca941a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:10.581916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac51c7-2493-4c54-9c9c-2164ca941a10 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:10.582633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac51c7-2493-4c54-9c9c-2164ca941a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:10.582940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac51c7-2493-4c54-9c9c-2164ca941a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:10.584424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac51c7-2493-4c54-9c9c-2164ca941a10 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:10.588482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.sql.core [None req-c0ec7e3e-3c6b-49b4-9128-a5c76ea04348 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 17:17:10.588482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 17:17:10.588482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [parameters: {'id': 'a308e39b837943b1b8d683bc8f185af2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 17:17:10.588482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80456) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 17:17:10.603452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 237/476] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:10.604563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac51c7-2493-4c54-9c9c-2164ca941a10 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-c0ec7e3e-3c6b-49b4-9128-a5c76ea04348 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result.read() Jun 16 17:17:10.616245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:17:10.617158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application yield resource Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise self.value Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application session.commit() Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 17:17:10.618058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.session.flush() Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application compat.raise_( Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 17:17:10.618922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:17:10.619785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result.read() Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:17:10.622815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [parameters: {'id': 'a308e39b837943b1b8d683bc8f185af2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:10.625276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 17:17:10.627444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:10.631733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 240/477] 10.222.0.77 () {60 vars in 1131 bytes} [Thu Jun 16 17:17:10 2022] POST /identity/v3/roles => generated 144 bytes in 286 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:10.631871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:10.640581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec7e3e-3c6b-49b4-9128-a5c76ea04348 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:10.741367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac51c7-2493-4c54-9c9c-2164ca941a10 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:10.756385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec7e3e-3c6b-49b4-9128-a5c76ea04348 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:10.781390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8f1bc-11b7-4abc-a6a1-c7b476b85fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:10.782507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8f1bc-11b7-4abc-a6a1-c7b476b85fb4 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:10.782982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8f1bc-11b7-4abc-a6a1-c7b476b85fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:10.783553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8f1bc-11b7-4abc-a6a1-c7b476b85fb4 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:10.784492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8f1bc-11b7-4abc-a6a1-c7b476b85fb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:10.786355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8f1bc-11b7-4abc-a6a1-c7b476b85fb4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:10.807838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:10.813687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08673dd8-80f2-41b6-88e1-8256c3419d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:10.814867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673dd8-80f2-41b6-88e1-8256c3419d8e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:10.815388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673dd8-80f2-41b6-88e1-8256c3419d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:10.815910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673dd8-80f2-41b6-88e1-8256c3419d8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:10.828352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08673dd8-80f2-41b6-88e1-8256c3419d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-08673dd8-80f2-41b6-88e1-8256c3419d8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:10.837207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:10.838104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 17:17:10.838870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:10.841709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 241/478] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:10.846828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08673dd8-80f2-41b6-88e1-8256c3419d8e None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:10.949274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 238/479] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:17:10 2022] POST /identity/v3/users => generated 249 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:10.966100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08673dd8-80f2-41b6-88e1-8256c3419d8e None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:11.047642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3514d-adaa-4e23-b977-f3f9d37ac2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:11.048819 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3514d-adaa-4e23-b977-f3f9d37ac2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:11.049310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3514d-adaa-4e23-b977-f3f9d37ac2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:11.049808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3514d-adaa-4e23-b977-f3f9d37ac2c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:11.050788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3514d-adaa-4e23-b977-f3f9d37ac2c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:11.051303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3514d-adaa-4e23-b977-f3f9d37ac2c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:11.053044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3514d-adaa-4e23-b977-f3f9d37ac2c3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:11.063925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 242/480] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:12.209560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4fe0e-ec91-40f0-9a2f-96972a812faa None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:12.210523 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4fe0e-ec91-40f0-9a2f-96972a812faa None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:12.211031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4fe0e-ec91-40f0-9a2f-96972a812faa None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:12.212611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 239/481] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:12.218107 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e76a4-215e-4bec-873a-2f1a1d5897d2 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:12.218962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e76a4-215e-4bec-873a-2f1a1d5897d2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:12.219434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e76a4-215e-4bec-873a-2f1a1d5897d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:12.241061 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-c52e76a4-215e-4bec-873a-2f1a1d5897d2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:12.242561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c52e76a4-215e-4bec-873a-2f1a1d5897d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:12.306121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:12.333491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 243/482] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:12.368992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4fe0e-ec91-40f0-9a2f-96972a812faa None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:12.449540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:12.498093 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4fe0e-ec91-40f0-9a2f-96972a812faa None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:12.552291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c620e00-3431-4809-af26-31ff678c2143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:12.553119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c620e00-3431-4809-af26-31ff678c2143 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:12.553404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c620e00-3431-4809-af26-31ff678c2143 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:12.553681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c620e00-3431-4809-af26-31ff678c2143 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:12.573184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c620e00-3431-4809-af26-31ff678c2143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7c620e00-3431-4809-af26-31ff678c2143 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:12.582178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:12.583068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:12.583838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 240/483] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:12.589507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e76a4-215e-4bec-873a-2f1a1d5897d2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:12.721525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e76a4-215e-4bec-873a-2f1a1d5897d2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:12.769301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a418b0-0a09-42d0-b957-5e7aa9a78459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:12.770313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a418b0-0a09-42d0-b957-5e7aa9a78459 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:12.770790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a418b0-0a09-42d0-b957-5e7aa9a78459 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:12.771277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a418b0-0a09-42d0-b957-5e7aa9a78459 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:12.772269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a418b0-0a09-42d0-b957-5e7aa9a78459 None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:12.772768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a418b0-0a09-42d0-b957-5e7aa9a78459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:12.774324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a418b0-0a09-42d0-b957-5e7aa9a78459 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:12.788404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 244/484] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:12.790499 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c620e00-3431-4809-af26-31ff678c2143 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:12.893875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be9b1a-c1cd-4d82-811c-ac846af01bf8 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:12.894195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be9b1a-c1cd-4d82-811c-ac846af01bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:12.894442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be9b1a-c1cd-4d82-811c-ac846af01bf8 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:12.896065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 245/485] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:12.900957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94123fa-0791-4a2c-90bd-ac059860b49f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:12.901249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94123fa-0791-4a2c-90bd-ac059860b49f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:12.901532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94123fa-0791-4a2c-90bd-ac059860b49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:12.930665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c620e00-3431-4809-af26-31ff678c2143 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:12.936632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-c94123fa-0791-4a2c-90bd-ac059860b49f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:12.937832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c94123fa-0791-4a2c-90bd-ac059860b49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:12.958112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:12.973344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90cf3-3f6c-4cb9-aad5-c24f75b2f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:12.974162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90cf3-3f6c-4cb9-aad5-c24f75b2f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:12.975837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90cf3-3f6c-4cb9-aad5-c24f75b2f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:12.975837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90cf3-3f6c-4cb9-aad5-c24f75b2f5d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:12.997785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c90cf3-3f6c-4cb9-aad5-c24f75b2f5d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:12.999303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c90cf3-3f6c-4cb9-aad5-c24f75b2f5d0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-92c90cf3-3f6c-4cb9-aad5-c24f75b2f5d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:13.024066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:13.025034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:13.025852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:13.025852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:13.025852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:13.025852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:13.025852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 241/486] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:13.026608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b9944-36cd-4d64-b5e6-98533758e7ae None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.026899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b9944-36cd-4d64-b5e6-98533758e7ae None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.027964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b9944-36cd-4d64-b5e6-98533758e7ae None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.029543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 242/487] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:13.033173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b9944-36cd-4d64-b5e6-98533758e7ae None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:13.037587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:13.071145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 246/488] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:13.072486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8ba55-72e6-48c8-86aa-e5c237e52ce2 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.072778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8ba55-72e6-48c8-86aa-e5c237e52ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.074852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8ba55-72e6-48c8-86aa-e5c237e52ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.091223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-01a8ba55-72e6-48c8-86aa-e5c237e52ce2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:13.092300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-01a8ba55-72e6-48c8-86aa-e5c237e52ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:13.166461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 247/489] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:13.172111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8ba55-72e6-48c8-86aa-e5c237e52ce2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:13.175124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b9944-36cd-4d64-b5e6-98533758e7ae None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:13.234661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40708d4-9baa-43cc-bd0b-35676cb7bfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:13.235416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40708d4-9baa-43cc-bd0b-35676cb7bfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.235711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40708d4-9baa-43cc-bd0b-35676cb7bfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.236403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40708d4-9baa-43cc-bd0b-35676cb7bfd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.237298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40708d4-9baa-43cc-bd0b-35676cb7bfd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:13.237634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40708d4-9baa-43cc-bd0b-35676cb7bfd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:13.239019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40708d4-9baa-43cc-bd0b-35676cb7bfd7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:13.260163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 243/490] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:13.260163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40708d4-9baa-43cc-bd0b-35676cb7bfd7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:13.301898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:13.306644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8ba55-72e6-48c8-86aa-e5c237e52ce2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:13.318563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:13.358743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bcead-e05f-4a08-8ee4-4291805491ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:13.359798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bcead-e05f-4a08-8ee4-4291805491ec None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.360283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bcead-e05f-4a08-8ee4-4291805491ec None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.360863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bcead-e05f-4a08-8ee4-4291805491ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.376681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bcead-e05f-4a08-8ee4-4291805491ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:13.377411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40708d4-9baa-43cc-bd0b-35676cb7bfd7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-7d3bcead-e05f-4a08-8ee4-4291805491ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:13.387354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:13.395997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 248/491] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:13.396812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bcead-e05f-4a08-8ee4-4291805491ec None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:13.431912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6b548-33a7-4854-b077-95d51221d811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:13.435452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b548-33a7-4854-b077-95d51221d811 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.435958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b548-33a7-4854-b077-95d51221d811 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.436555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b548-33a7-4854-b077-95d51221d811 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.453986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6b548-33a7-4854-b077-95d51221d811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ccb6b548-33a7-4854-b077-95d51221d811 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:13.467271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:13.468203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:13.468981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:13.476164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 244/492] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:13.478794 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6b548-33a7-4854-b077-95d51221d811 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:13.515252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bcead-e05f-4a08-8ee4-4291805491ec None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:13.552971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c93e1-ef89-4c83-8c22-49875ca33973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:13.553738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c93e1-ef89-4c83-8c22-49875ca33973 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.554024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c93e1-ef89-4c83-8c22-49875ca33973 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.554303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c93e1-ef89-4c83-8c22-49875ca33973 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.563726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c93e1-ef89-4c83-8c22-49875ca33973 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:13.565015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c93e1-ef89-4c83-8c22-49875ca33973 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-7f5c93e1-ef89-4c83-8c22-49875ca33973 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:13.588355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:13.589349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:13.590869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:13.590869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:13.590869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:13.590869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:13.590869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:13.590869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:13.590869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:13.590869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:13.590869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:17:13.590869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:13.594201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 249/493] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:13.595139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c93e1-ef89-4c83-8c22-49875ca33973 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:13.624958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:13.626291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:13.635216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6b548-33a7-4854-b077-95d51221d811 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:13.682565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f065f7-f12d-42e9-b487-05c38301a9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:13.684297 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f065f7-f12d-42e9-b487-05c38301a9cb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.684840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f065f7-f12d-42e9-b487-05c38301a9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.685192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f065f7-f12d-42e9-b487-05c38301a9cb None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.686408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f065f7-f12d-42e9-b487-05c38301a9cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:13.687057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f065f7-f12d-42e9-b487-05c38301a9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:13.688742 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f065f7-f12d-42e9-b487-05c38301a9cb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:13.705221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 245/494] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:13.706255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f065f7-f12d-42e9-b487-05c38301a9cb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:13.707477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c93e1-ef89-4c83-8c22-49875ca33973 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:13.758990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47518f-0865-4f10-a2cc-3f525066e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:13.759684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47518f-0865-4f10-a2cc-3f525066e9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.759973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47518f-0865-4f10-a2cc-3f525066e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.760301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47518f-0865-4f10-a2cc-3f525066e9f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.763056 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47518f-0865-4f10-a2cc-3f525066e9f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:13.763568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47518f-0865-4f10-a2cc-3f525066e9f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:13.765460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47518f-0865-4f10-a2cc-3f525066e9f3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:13.775129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 250/495] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:13.776045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47518f-0865-4f10-a2cc-3f525066e9f3 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:13.835501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f065f7-f12d-42e9-b487-05c38301a9cb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:13.874505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f16bb-d8f2-4022-81b8-860a5479eb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:13.874770 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:13.875221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f16bb-d8f2-4022-81b8-860a5479eb5e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.875525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f16bb-d8f2-4022-81b8-860a5479eb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.875793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f16bb-d8f2-4022-81b8-860a5479eb5e None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.876694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f16bb-d8f2-4022-81b8-860a5479eb5e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:13.877007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f16bb-d8f2-4022-81b8-860a5479eb5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:13.878669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f16bb-d8f2-4022-81b8-860a5479eb5e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:13.890109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47518f-0865-4f10-a2cc-3f525066e9f3 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:13.925222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 246/496] 10.222.0.77 () {56 vars in 1137 bytes} [Thu Jun 16 17:17:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:13.925222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f16bb-d8f2-4022-81b8-860a5479eb5e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:13.934465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e1b43-b64f-4829-b3b4-2a3ef9d306d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:13.935589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e1b43-b64f-4829-b3b4-2a3ef9d306d8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.935875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e1b43-b64f-4829-b3b4-2a3ef9d306d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.936184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e1b43-b64f-4829-b3b4-2a3ef9d306d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.940991 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:13.947096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e1b43-b64f-4829-b3b4-2a3ef9d306d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:13.949244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e1b43-b64f-4829-b3b4-2a3ef9d306d8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-225e1b43-b64f-4829-b3b4-2a3ef9d306d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:13.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:13.967680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:13.969013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:13.969013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:13.969013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:13.969013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:13.969013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 251/497] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:13.969394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41caf7a-0eb1-43d2-bd1f-77586aae4bf2 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:13.969647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41caf7a-0eb1-43d2-bd1f-77586aae4bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:13.969923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41caf7a-0eb1-43d2-bd1f-77586aae4bf2 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:13.971413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 252/498] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:13.972147 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41caf7a-0eb1-43d2-bd1f-77586aae4bf2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:14.029532 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f16bb-d8f2-4022-81b8-860a5479eb5e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:14.063833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae35c36-9ac6-4564-a9be-9ac65c0653c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:14.064657 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae35c36-9ac6-4564-a9be-9ac65c0653c3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.064938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae35c36-9ac6-4564-a9be-9ac65c0653c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.065211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae35c36-9ac6-4564-a9be-9ac65c0653c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.076218 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae35c36-9ac6-4564-a9be-9ac65c0653c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:14.077438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41caf7a-0eb1-43d2-bd1f-77586aae4bf2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:14.077663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae35c36-9ac6-4564-a9be-9ac65c0653c3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-bae35c36-9ac6-4564-a9be-9ac65c0653c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:14.095669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:14.096713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:14.097538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:14.097538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:14.097538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:14.097538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:14.097538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 247/499] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:14.098360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea4091-e6b3-46ca-a960-907fa1c52571 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.098360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea4091-e6b3-46ca-a960-907fa1c52571 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.098838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea4091-e6b3-46ca-a960-907fa1c52571 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.099941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 248/500] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:14.100655 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea4091-e6b3-46ca-a960-907fa1c52571 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:14.117219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac210a-53b0-4838-a591-8a7d178c0868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:14.117864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac210a-53b0-4838-a591-8a7d178c0868 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.118143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac210a-53b0-4838-a591-8a7d178c0868 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.118418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac210a-53b0-4838-a591-8a7d178c0868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.129617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:14.172687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:14.187380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac210a-53b0-4838-a591-8a7d178c0868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:14.188864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac210a-53b0-4838-a591-8a7d178c0868 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:14.208309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea4091-e6b3-46ca-a960-907fa1c52571 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:14.243536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fd32b-5da8-47e0-a9b6-57da6157ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:14.244232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fd32b-5da8-47e0-a9b6-57da6157ca68 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.244520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fd32b-5da8-47e0-a9b6-57da6157ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.244796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fd32b-5da8-47e0-a9b6-57da6157ca68 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.245563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fd32b-5da8-47e0-a9b6-57da6157ca68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:14.245934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fd32b-5da8-47e0-a9b6-57da6157ca68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:14.247311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fd32b-5da8-47e0-a9b6-57da6157ca68 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:14.258784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 249/501] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:14.260050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5405095-2d79-4eeb-8de5-bbb893b7fad8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.260374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5405095-2d79-4eeb-8de5-bbb893b7fad8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.260654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5405095-2d79-4eeb-8de5-bbb893b7fad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.277521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b5405095-2d79-4eeb-8de5-bbb893b7fad8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:14.278894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b5405095-2d79-4eeb-8de5-bbb893b7fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:14.289705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 253/502] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:14.290531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac210a-53b0-4838-a591-8a7d178c0868 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:14.333793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:14.349616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 250/503] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:14.351258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd85e04-31e3-4c4c-bca5-38eae0b7eb66 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.351554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd85e04-31e3-4c4c-bca5-38eae0b7eb66 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.351835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd85e04-31e3-4c4c-bca5-38eae0b7eb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.368473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-afd85e04-31e3-4c4c-bca5-38eae0b7eb66 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:14.369672 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-afd85e04-31e3-4c4c-bca5-38eae0b7eb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:14.399337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac210a-53b0-4838-a591-8a7d178c0868 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:14.423824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:14.433889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6545cf9-f8e0-47ef-b8d7-5e0f0398ae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:14.437972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6545cf9-f8e0-47ef-b8d7-5e0f0398ae0b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.437972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6545cf9-f8e0-47ef-b8d7-5e0f0398ae0b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.437972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6545cf9-f8e0-47ef-b8d7-5e0f0398ae0b None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.437972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6545cf9-f8e0-47ef-b8d7-5e0f0398ae0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:14.437972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6545cf9-f8e0-47ef-b8d7-5e0f0398ae0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:14.437972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6545cf9-f8e0-47ef-b8d7-5e0f0398ae0b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:14.440357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 251/504] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:14.441090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd85e04-31e3-4c4c-bca5-38eae0b7eb66 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:14.449688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 254/505] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:14.450319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6545cf9-f8e0-47ef-b8d7-5e0f0398ae0b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:14.545662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd85e04-31e3-4c4c-bca5-38eae0b7eb66 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:14.546165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:14.551497 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6545cf9-f8e0-47ef-b8d7-5e0f0398ae0b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:14.582816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96095086-9335-4734-a390-d3edbe333aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:14.583625 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96095086-9335-4734-a390-d3edbe333aee None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.583913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96095086-9335-4734-a390-d3edbe333aee None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.584227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96095086-9335-4734-a390-d3edbe333aee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.586722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51e3d0-e7cb-4064-ac30-b46cec8ab565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:14.587516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e3d0-e7cb-4064-ac30-b46cec8ab565 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.587801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e3d0-e7cb-4064-ac30-b46cec8ab565 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.588096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e3d0-e7cb-4064-ac30-b46cec8ab565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.592555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96095086-9335-4734-a390-d3edbe333aee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:14.594026 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96095086-9335-4734-a390-d3edbe333aee None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:14.599258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51e3d0-e7cb-4064-ac30-b46cec8ab565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:14.600795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51e3d0-e7cb-4064-ac30-b46cec8ab565 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-96095086-9335-4734-a390-d3edbe333aee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:14.610583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:14.611731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:14.612647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 252/506] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:14.613412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96095086-9335-4734-a390-d3edbe333aee None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-7c51e3d0-e7cb-4064-ac30-b46cec8ab565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:14.621935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:14.623001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:14.625812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:14.625812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:14.625812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:14.625812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:14.625812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 255/507] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:14.625812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51e3d0-e7cb-4064-ac30-b46cec8ab565 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:14.669214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:14.719888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96095086-9335-4734-a390-d3edbe333aee None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:14.724269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51e3d0-e7cb-4064-ac30-b46cec8ab565 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:14.753988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec3e8-0a27-4e61-99ae-935d92e3db64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:14.754792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec3e8-0a27-4e61-99ae-935d92e3db64 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.755077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec3e8-0a27-4e61-99ae-935d92e3db64 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.755352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec3e8-0a27-4e61-99ae-935d92e3db64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.757345 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933eebd-e7a3-4607-aa95-62e925d253d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:14.758130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933eebd-e7a3-4607-aa95-62e925d253d0 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.758411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933eebd-e7a3-4607-aa95-62e925d253d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.758684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933eebd-e7a3-4607-aa95-62e925d253d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.766243 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeec3e8-0a27-4e61-99ae-935d92e3db64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:14.767708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933eebd-e7a3-4607-aa95-62e925d253d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:14.769184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933eebd-e7a3-4607-aa95-62e925d253d0 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2eeec3e8-0a27-4e61-99ae-935d92e3db64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:14.774029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:14.774920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:14.775729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 253/508] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:14.776452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec3e8-0a27-4e61-99ae-935d92e3db64 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-1933eebd-e7a3-4607-aa95-62e925d253d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:14.785037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:14.786034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:14.786932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 256/509] 10.222.0.77 () {56 vars in 1093 bytes} [Thu Jun 16 17:17:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:14.787766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933eebd-e7a3-4607-aa95-62e925d253d0 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:14.803068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:14.877585 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec3e8-0a27-4e61-99ae-935d92e3db64 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:14.887100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:14.889627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933eebd-e7a3-4607-aa95-62e925d253d0 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:14.911396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4d915-8865-4040-85b0-7456f351fe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:14.912236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4d915-8865-4040-85b0-7456f351fe83 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.912521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4d915-8865-4040-85b0-7456f351fe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.912795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4d915-8865-4040-85b0-7456f351fe83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.923079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4d915-8865-4040-85b0-7456f351fe83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:14.924560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4d915-8865-4040-85b0-7456f351fe83 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:14.924735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c401f4-82db-4b02-a93f-bf00b6c19be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:14.925407 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c401f4-82db-4b02-a93f-bf00b6c19be8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:14.925692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c401f4-82db-4b02-a93f-bf00b6c19be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:14.925968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c401f4-82db-4b02-a93f-bf00b6c19be8 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:14.926789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c401f4-82db-4b02-a93f-bf00b6c19be8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:14.927099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c401f4-82db-4b02-a93f-bf00b6c19be8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:14.928538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c401f4-82db-4b02-a93f-bf00b6c19be8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6ab4d915-8865-4040-85b0-7456f351fe83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:14.942504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:14.943391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:14.944244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:14.944244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:14.944244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:14.944244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:14.944244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 254/510] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:14.944517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4d915-8865-4040-85b0-7456f351fe83 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:14.972287 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 257/511] 10.222.0.77 () {56 vars in 1137 bytes} [Thu Jun 16 17:17:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:14.973125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c401f4-82db-4b02-a93f-bf00b6c19be8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:15.045575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:15.045770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4d915-8865-4040-85b0-7456f351fe83 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:15.076604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c401f4-82db-4b02-a93f-bf00b6c19be8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:15.078913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea74a2-c68b-40b7-82f7-7ef0b8fe7898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:15.079575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea74a2-c68b-40b7-82f7-7ef0b8fe7898 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.079858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea74a2-c68b-40b7-82f7-7ef0b8fe7898 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.080163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea74a2-c68b-40b7-82f7-7ef0b8fe7898 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.080876 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea74a2-c68b-40b7-82f7-7ef0b8fe7898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:15.081183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea74a2-c68b-40b7-82f7-7ef0b8fe7898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:15.082562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea74a2-c68b-40b7-82f7-7ef0b8fe7898 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:15.094188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 255/512] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:15.094975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea74a2-c68b-40b7-82f7-7ef0b8fe7898 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:15.113084 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b1452-0b37-4fc6-91e4-4dc68d115c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:15.113759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b1452-0b37-4fc6-91e4-4dc68d115c21 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.114045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b1452-0b37-4fc6-91e4-4dc68d115c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.114323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b1452-0b37-4fc6-91e4-4dc68d115c21 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.115068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b1452-0b37-4fc6-91e4-4dc68d115c21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:15.115379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b1452-0b37-4fc6-91e4-4dc68d115c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:15.116793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b1452-0b37-4fc6-91e4-4dc68d115c21 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:15.117412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:15.125631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 258/513] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:15.125631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b1452-0b37-4fc6-91e4-4dc68d115c21 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:15.197062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea74a2-c68b-40b7-82f7-7ef0b8fe7898 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:15.230558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b1452-0b37-4fc6-91e4-4dc68d115c21 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:15.230873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a3f23-5234-43c7-954f-f0a356438ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:15.231546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a3f23-5234-43c7-954f-f0a356438ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.231828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a3f23-5234-43c7-954f-f0a356438ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.232129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a3f23-5234-43c7-954f-f0a356438ac0 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.232952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a3f23-5234-43c7-954f-f0a356438ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:15.233265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a3f23-5234-43c7-954f-f0a356438ac0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:15.234692 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a3f23-5234-43c7-954f-f0a356438ac0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:15.251984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 256/514] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Jun 16 17:17:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:15.252811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a3f23-5234-43c7-954f-f0a356438ac0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:15.259824 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:15.265252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a83e-dbe1-4fe2-9dcb-b6cf03a583c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:15.265959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a83e-dbe1-4fe2-9dcb-b6cf03a583c6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.266248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a83e-dbe1-4fe2-9dcb-b6cf03a583c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.266524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a83e-dbe1-4fe2-9dcb-b6cf03a583c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.267243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2a83e-dbe1-4fe2-9dcb-b6cf03a583c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:15.267549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2a83e-dbe1-4fe2-9dcb-b6cf03a583c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:15.268966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2a83e-dbe1-4fe2-9dcb-b6cf03a583c6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:15.280851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 259/515] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:15.281723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a83e-dbe1-4fe2-9dcb-b6cf03a583c6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:15.334402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:15.355476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a3f23-5234-43c7-954f-f0a356438ac0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:15.381733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a83e-dbe1-4fe2-9dcb-b6cf03a583c6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:15.390873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55030f9d-b01d-4e0f-98b4-71cf60bc8cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:15.391532 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55030f9d-b01d-4e0f-98b4-71cf60bc8cfa None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.391812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55030f9d-b01d-4e0f-98b4-71cf60bc8cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.392110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55030f9d-b01d-4e0f-98b4-71cf60bc8cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.415347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ca16d-9dbb-4149-bb91-216e87c4ae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:15.416164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ca16d-9dbb-4149-bb91-216e87c4ae22 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.416450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ca16d-9dbb-4149-bb91-216e87c4ae22 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.416728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ca16d-9dbb-4149-bb91-216e87c4ae22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.424046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ca16d-9dbb-4149-bb91-216e87c4ae22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:15.425524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ca16d-9dbb-4149-bb91-216e87c4ae22 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-be3ca16d-9dbb-4149-bb91-216e87c4ae22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:15.439693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:15.440572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:15.441404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:15.441404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:15.441404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:15.441404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:15.441404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:15.441404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:15.441404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:15.441404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:15.441404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 260/516] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:15.441861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ca16d-9dbb-4149-bb91-216e87c4ae22 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:15.461649 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55030f9d-b01d-4e0f-98b4-71cf60bc8cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:15.463028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55030f9d-b01d-4e0f-98b4-71cf60bc8cfa None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:15.495244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:15.541538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:15.543864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ca16d-9dbb-4149-bb91-216e87c4ae22 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:15.563569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 257/517] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:15.564438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55030f9d-b01d-4e0f-98b4-71cf60bc8cfa None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:15.578698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2d9d6-9c4d-45be-a4f7-c54e42fb1207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:15.579493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2d9d6-9c4d-45be-a4f7-c54e42fb1207 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.579775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2d9d6-9c4d-45be-a4f7-c54e42fb1207 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.580050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2d9d6-9c4d-45be-a4f7-c54e42fb1207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.591126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2d9d6-9c4d-45be-a4f7-c54e42fb1207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:15.592609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2d9d6-9c4d-45be-a4f7-c54e42fb1207 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b7c2d9d6-9c4d-45be-a4f7-c54e42fb1207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:15.609973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:15.610814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:15.611624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:15.611624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:15.611624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:15.611624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:15.611624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 261/518] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:15.611886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2d9d6-9c4d-45be-a4f7-c54e42fb1207 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:15.669935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55030f9d-b01d-4e0f-98b4-71cf60bc8cfa None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:15.703006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6368e9e-163e-4f8a-acbd-28d806bb2fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:15.703658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6368e9e-163e-4f8a-acbd-28d806bb2fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.703945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6368e9e-163e-4f8a-acbd-28d806bb2fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.704258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6368e9e-163e-4f8a-acbd-28d806bb2fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.714606 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2d9d6-9c4d-45be-a4f7-c54e42fb1207 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:15.717663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:15.748691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a934a4e-cf7d-4001-8a45-7d3889e12e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:15.749354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a934a4e-cf7d-4001-8a45-7d3889e12e8a None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:15.749639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a934a4e-cf7d-4001-8a45-7d3889e12e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:15.749909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a934a4e-cf7d-4001-8a45-7d3889e12e8a None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:15.750547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:15.750662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a934a4e-cf7d-4001-8a45-7d3889e12e8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:15.752026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a934a4e-cf7d-4001-8a45-7d3889e12e8a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:15.771944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6368e9e-163e-4f8a-acbd-28d806bb2fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:15.773490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6368e9e-163e-4f8a-acbd-28d806bb2fc9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:15.854325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 262/519] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:17:15 2022] POST /identity/v3/users => generated 247 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:15.855296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a934a4e-cf7d-4001-8a45-7d3889e12e8a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:15.871132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 258/520] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:15.871899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6368e9e-163e-4f8a-acbd-28d806bb2fc9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:15.970321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:15.976037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a934a4e-cf7d-4001-8a45-7d3889e12e8a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:15.995897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6368e9e-163e-4f8a-acbd-28d806bb2fc9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.013169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7496d-d327-4566-9f60-36d6580bf795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.013853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7496d-d327-4566-9f60-36d6580bf795 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.014141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7496d-d327-4566-9f60-36d6580bf795 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.014675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7496d-d327-4566-9f60-36d6580bf795 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.015478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7496d-d327-4566-9f60-36d6580bf795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:16.015793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7496d-d327-4566-9f60-36d6580bf795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.017311 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7496d-d327-4566-9f60-36d6580bf795 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.037102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 263/521] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:16.037102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7496d-d327-4566-9f60-36d6580bf795 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.042835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d369b-f9bc-4b09-b200-7b61b226413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.042835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d369b-f9bc-4b09-b200-7b61b226413e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.042835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d369b-f9bc-4b09-b200-7b61b226413e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.042835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d369b-f9bc-4b09-b200-7b61b226413e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.055979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d369b-f9bc-4b09-b200-7b61b226413e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.057482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d369b-f9bc-4b09-b200-7b61b226413e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.060392 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5d9d369b-f9bc-4b09-b200-7b61b226413e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:16.076723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:16.077748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:16.078640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:16.078640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:16.078640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:16.078640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:16.078640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 259/522] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:16.079849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d369b-f9bc-4b09-b200-7b61b226413e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.147357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7496d-d327-4566-9f60-36d6580bf795 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.183658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79eca74-d358-4964-8bf1-bb071265d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.184430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eca74-d358-4964-8bf1-bb071265d616 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.184718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eca74-d358-4964-8bf1-bb071265d616 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.184999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eca74-d358-4964-8bf1-bb071265d616 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.185711 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79eca74-d358-4964-8bf1-bb071265d616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:16.186022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79eca74-d358-4964-8bf1-bb071265d616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.187404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79eca74-d358-4964-8bf1-bb071265d616 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.193638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d369b-f9bc-4b09-b200-7b61b226413e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.204059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 264/523] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:16.204059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79eca74-d358-4964-8bf1-bb071265d616 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.226166 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:16.233087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b1fac-c0b3-45db-a8a4-f8b68b11a20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.233983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1fac-c0b3-45db-a8a4-f8b68b11a20c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.234339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1fac-c0b3-45db-a8a4-f8b68b11a20c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.234623 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1fac-c0b3-45db-a8a4-f8b68b11a20c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.244795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b1fac-c0b3-45db-a8a4-f8b68b11a20c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.246962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b1fac-c0b3-45db-a8a4-f8b68b11a20c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-762b1fac-c0b3-45db-a8a4-f8b68b11a20c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:16.267194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:16.268715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:16.269689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:16.269689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:16.269689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:16.269689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:16.271224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 260/524] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:16.272179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b1fac-c0b3-45db-a8a4-f8b68b11a20c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.300848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:16.321409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79eca74-d358-4964-8bf1-bb071265d616 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.360230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ca364-349c-4cce-8ae0-0c7cdf137d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.360880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ca364-349c-4cce-8ae0-0c7cdf137d12 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.361167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ca364-349c-4cce-8ae0-0c7cdf137d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.361446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ca364-349c-4cce-8ae0-0c7cdf137d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ca364-349c-4cce-8ae0-0c7cdf137d12 None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=dff915d0b23d4b9ebd70e6b6b885aca9) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:16.362580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ca364-349c-4cce-8ae0-0c7cdf137d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.364004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ca364-349c-4cce-8ae0-0c7cdf137d12 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.369696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 265/525] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/role_assignments?user.id=dff915d0b23d4b9ebd70e6b6b885aca9&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:16.371081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ca364-349c-4cce-8ae0-0c7cdf137d12 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.392813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b1fac-c0b3-45db-a8a4-f8b68b11a20c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.439105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210634b5-b2dc-4ac1-baef-d39eb449013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.440199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210634b5-b2dc-4ac1-baef-d39eb449013d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.440693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210634b5-b2dc-4ac1-baef-d39eb449013d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.441170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210634b5-b2dc-4ac1-baef-d39eb449013d None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.442108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210634b5-b2dc-4ac1-baef-d39eb449013d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:16.442630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210634b5-b2dc-4ac1-baef-d39eb449013d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.444326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210634b5-b2dc-4ac1-baef-d39eb449013d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.458062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 261/526] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:16.459247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210634b5-b2dc-4ac1-baef-d39eb449013d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.507718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ca364-349c-4cce-8ae0-0c7cdf137d12 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.523347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:16.553183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf70027-7903-4834-86d2-9cf2a68bd3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.579929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70027-7903-4834-86d2-9cf2a68bd3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.579929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70027-7903-4834-86d2-9cf2a68bd3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.579929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70027-7903-4834-86d2-9cf2a68bd3a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.579929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf70027-7903-4834-86d2-9cf2a68bd3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.579929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf70027-7903-4834-86d2-9cf2a68bd3a5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.579929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-6bf70027-7903-4834-86d2-9cf2a68bd3a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:17:16.579929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:16.580983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:16.581817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:16.582757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:16.582757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:16.582757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:16.582757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:16.582757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:16.582757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:16.582757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:17:16.582757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:16.584277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 266/527] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:16.585312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf70027-7903-4834-86d2-9cf2a68bd3a5 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.590343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:16.612587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210634b5-b2dc-4ac1-baef-d39eb449013d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.650160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf2f90-641c-49dd-ac2c-77f6bfa99e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.651218 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2f90-641c-49dd-ac2c-77f6bfa99e97 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.652322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2f90-641c-49dd-ac2c-77f6bfa99e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.653128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2f90-641c-49dd-ac2c-77f6bfa99e97 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.654165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf2f90-641c-49dd-ac2c-77f6bfa99e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:16.654687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf2f90-641c-49dd-ac2c-77f6bfa99e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.656323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf2f90-641c-49dd-ac2c-77f6bfa99e97 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.671210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 262/528] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:16.672436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf2f90-641c-49dd-ac2c-77f6bfa99e97 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.722514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf70027-7903-4834-86d2-9cf2a68bd3a5 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.770564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb9446-cbf9-407c-a1b2-787ce958e154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.771318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb9446-cbf9-407c-a1b2-787ce958e154 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.771604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb9446-cbf9-407c-a1b2-787ce958e154 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.771873 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb9446-cbf9-407c-a1b2-787ce958e154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.781746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb9446-cbf9-407c-a1b2-787ce958e154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.783795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb9446-cbf9-407c-a1b2-787ce958e154 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.788224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf2f90-641c-49dd-ac2c-77f6bfa99e97 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.790143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-cbfb9446-cbf9-407c-a1b2-787ce958e154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:16.802776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:16.804960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:16.805822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:16.805822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:16.805822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:16.805822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:16.805822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:16.805822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:16.805822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:16.805822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:16.805822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 267/529] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:16.805822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb9446-cbf9-407c-a1b2-787ce958e154 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.828823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c10f-cb69-4177-9818-38080cb2d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.830131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c10f-cb69-4177-9818-38080cb2d6ee None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.830643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c10f-cb69-4177-9818-38080cb2d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.831122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5c10f-cb69-4177-9818-38080cb2d6ee None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.832264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5c10f-cb69-4177-9818-38080cb2d6ee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:16.832882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5c10f-cb69-4177-9818-38080cb2d6ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.834507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5c10f-cb69-4177-9818-38080cb2d6ee None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:16.855236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 263/530] 10.222.0.77 () {56 vars in 1139 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:16.856692 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c10f-cb69-4177-9818-38080cb2d6ee None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:16.884503 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:16.937705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb9446-cbf9-407c-a1b2-787ce958e154 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.971014 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5c10f-cb69-4177-9818-38080cb2d6ee None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:16.981455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe96f-3454-4710-9442-92bde92356a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:16.982786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe96f-3454-4710-9442-92bde92356a8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:16.983070 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe96f-3454-4710-9442-92bde92356a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:16.983348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe96f-3454-4710-9442-92bde92356a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:16.993701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe96f-3454-4710-9442-92bde92356a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:16.996133 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe96f-3454-4710-9442-92bde92356a8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:17.013426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72299e28-6f57-4053-846d-b225e19b2ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-0cdbe96f-3454-4710-9442-92bde92356a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:17.014528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:17.015355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:17.016229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:17.016229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:17.016229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:17.016229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:17.016229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:17.016229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:17.016229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:17.016229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:17.016229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 268/531] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:17.017108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe96f-3454-4710-9442-92bde92356a8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:17.017486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72299e28-6f57-4053-846d-b225e19b2ebd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:17.017972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72299e28-6f57-4053-846d-b225e19b2ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:17.018437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72299e28-6f57-4053-846d-b225e19b2ebd None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:17.019536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72299e28-6f57-4053-846d-b225e19b2ebd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:17.020050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72299e28-6f57-4053-846d-b225e19b2ebd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:17.021994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72299e28-6f57-4053-846d-b225e19b2ebd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:17.043144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 264/532] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:17.044580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72299e28-6f57-4053-846d-b225e19b2ebd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:17.073080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:17.152274 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe96f-3454-4710-9442-92bde92356a8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:17.161176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72299e28-6f57-4053-846d-b225e19b2ebd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:17.178756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:17.191096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415db0c-1850-4963-9af7-bf7fc77705e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:17.193912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415db0c-1850-4963-9af7-bf7fc77705e9 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:17.193912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415db0c-1850-4963-9af7-bf7fc77705e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:17.193912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415db0c-1850-4963-9af7-bf7fc77705e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:17.199328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f635e-8aa4-407b-a7bd-146e23b05d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:17.200390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f635e-8aa4-407b-a7bd-146e23b05d36 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:17.200883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f635e-8aa4-407b-a7bd-146e23b05d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:17.201364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f635e-8aa4-407b-a7bd-146e23b05d36 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:17.202382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f635e-8aa4-407b-a7bd-146e23b05d36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:17.202893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f635e-8aa4-407b-a7bd-146e23b05d36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:17.204594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f635e-8aa4-407b-a7bd-146e23b05d36 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:17.218549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 265/533] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:17.219732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f635e-8aa4-407b-a7bd-146e23b05d36 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:17.267958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415db0c-1850-4963-9af7-bf7fc77705e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:17.269575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415db0c-1850-4963-9af7-bf7fc77705e9 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:17.306391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:17.327492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f635e-8aa4-407b-a7bd-146e23b05d36 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:17.365453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1cd84-ab5f-473a-b6fb-0650578d6aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:17.366460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1cd84-ab5f-473a-b6fb-0650578d6aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:17.366970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1cd84-ab5f-473a-b6fb-0650578d6aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:17.367533 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1cd84-ab5f-473a-b6fb-0650578d6aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:17.368710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1cd84-ab5f-473a-b6fb-0650578d6aa6 None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=adf46b0ab3b9400d8fc44ba3a1574f27) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:17.369250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1cd84-ab5f-473a-b6fb-0650578d6aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:17.370902 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1cd84-ab5f-473a-b6fb-0650578d6aa6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:17.377025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 266/534] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:17 2022] GET /identity/v3/role_assignments?user.id=adf46b0ab3b9400d8fc44ba3a1574f27&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:17.378017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1cd84-ab5f-473a-b6fb-0650578d6aa6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:17.380315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 269/535] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:17.393325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415db0c-1850-4963-9af7-bf7fc77705e9 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:17.440020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:17.497999 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1cd84-ab5f-473a-b6fb-0650578d6aa6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:17.540612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ba5b4-be7e-4ea5-90dd-850d93b1e50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:17.541671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ba5b4-be7e-4ea5-90dd-850d93b1e50e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:17.542716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ba5b4-be7e-4ea5-90dd-850d93b1e50e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:17.543354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ba5b4-be7e-4ea5-90dd-850d93b1e50e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:17.544566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ba5b4-be7e-4ea5-90dd-850d93b1e50e None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=ba0bb071b7c04e1da55259f079a9c805) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:17.545155 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ba5b4-be7e-4ea5-90dd-850d93b1e50e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:17.546872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ba5b4-be7e-4ea5-90dd-850d93b1e50e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:17.554208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 267/536] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:17 2022] GET /identity/v3/role_assignments?user.id=ba0bb071b7c04e1da55259f079a9c805&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:17.605423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415db0c-1850-4963-9af7-bf7fc77705e9 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:17.647438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aa742-e224-475b-ab3b-76a7fc9ffa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:17.648292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa742-e224-475b-ab3b-76a7fc9ffa1c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:17.648579 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa742-e224-475b-ab3b-76a7fc9ffa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:17.648856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa742-e224-475b-ab3b-76a7fc9ffa1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:17.661027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aa742-e224-475b-ab3b-76a7fc9ffa1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:17.662694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aa742-e224-475b-ab3b-76a7fc9ffa1c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-420aa742-e224-475b-ab3b-76a7fc9ffa1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:17.687418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:17.688381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:17.689207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:17.689207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:17.689207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:17.689207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:17.689207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 270/537] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:17.699199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ba5b4-be7e-4ea5-90dd-850d93b1e50e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:17.715696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:17.840562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ba5b4-be7e-4ea5-90dd-850d93b1e50e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:17.881040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32858d-2698-4a41-827b-711e3c9d448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:17.881723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32858d-2698-4a41-827b-711e3c9d448a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:17.882007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32858d-2698-4a41-827b-711e3c9d448a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:17.882312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32858d-2698-4a41-827b-711e3c9d448a None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:17.883139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32858d-2698-4a41-827b-711e3c9d448a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:17.883449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32858d-2698-4a41-827b-711e3c9d448a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:17.884845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32858d-2698-4a41-827b-711e3c9d448a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:17.903778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 268/538] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:17.909300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aa742-e224-475b-ab3b-76a7fc9ffa1c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:18.018156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:18.050198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aa742-e224-475b-ab3b-76a7fc9ffa1c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:18.114650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58cc4b-c1f8-4210-9c08-1cafc3ca6a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:18.115543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58cc4b-c1f8-4210-9c08-1cafc3ca6a28 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:18.115929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58cc4b-c1f8-4210-9c08-1cafc3ca6a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:18.116340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58cc4b-c1f8-4210-9c08-1cafc3ca6a28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:18.128731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58cc4b-c1f8-4210-9c08-1cafc3ca6a28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:18.130392 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58cc4b-c1f8-4210-9c08-1cafc3ca6a28 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-2d58cc4b-c1f8-4210-9c08-1cafc3ca6a28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:18.149252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:18.150324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:18.151339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:18.151339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:18.151339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:18.151339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:18.151339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:18.151339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:18.151339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:18.151339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:18.159889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 271/539] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:18.160091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32858d-2698-4a41-827b-711e3c9d448a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:18.237830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da035342-9d05-4bc8-b77d-721efa15acd3 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:18.239135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da035342-9d05-4bc8-b77d-721efa15acd3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:18.239587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da035342-9d05-4bc8-b77d-721efa15acd3 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:18.241345 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 272/540] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:18.248871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25125e12-ba85-4599-9441-d75d61b229ae None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:18.249322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25125e12-ba85-4599-9441-d75d61b229ae None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:18.249707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25125e12-ba85-4599-9441-d75d61b229ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:18.287622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-25125e12-ba85-4599-9441-d75d61b229ae None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:18.288877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-25125e12-ba85-4599-9441-d75d61b229ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:18.306129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:18.363051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32858d-2698-4a41-827b-711e3c9d448a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:18.404933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a1b67-4fc9-4cc3-b84a-38bcec5bd1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:18.405610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a1b67-4fc9-4cc3-b84a-38bcec5bd1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:18.405899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a1b67-4fc9-4cc3-b84a-38bcec5bd1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:18.406179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a1b67-4fc9-4cc3-b84a-38bcec5bd1e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:18.406970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a1b67-4fc9-4cc3-b84a-38bcec5bd1e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:18.407287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a1b67-4fc9-4cc3-b84a-38bcec5bd1e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:18.408875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a1b67-4fc9-4cc3-b84a-38bcec5bd1e9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:18.422368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 269/541] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:18.428344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a1b67-4fc9-4cc3-b84a-38bcec5bd1e9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:18.461785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 273/542] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:17:18.498672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25125e12-ba85-4599-9441-d75d61b229ae None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:18.546661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a1b67-4fc9-4cc3-b84a-38bcec5bd1e9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:18.584102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc60a95-56c3-483f-abba-9c9a3074d0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:18.588095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc60a95-56c3-483f-abba-9c9a3074d0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:18.588095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc60a95-56c3-483f-abba-9c9a3074d0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:18.588095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc60a95-56c3-483f-abba-9c9a3074d0e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:18.588095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc60a95-56c3-483f-abba-9c9a3074d0e6 None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=19ce01cdbd8d4ac9bb126a6814f2d13b) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:18.588095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc60a95-56c3-483f-abba-9c9a3074d0e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:18.588095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc60a95-56c3-483f-abba-9c9a3074d0e6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:18.592401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:18.595441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 270/543] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:18 2022] GET /identity/v3/role_assignments?user.id=19ce01cdbd8d4ac9bb126a6814f2d13b&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:18.668902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:18.723947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25125e12-ba85-4599-9441-d75d61b229ae None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:18.774984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49168639-807e-4dc4-8488-752e9d9af4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:18.775820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49168639-807e-4dc4-8488-752e9d9af4cb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:18.776132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49168639-807e-4dc4-8488-752e9d9af4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:18.776911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49168639-807e-4dc4-8488-752e9d9af4cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:18.790179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49168639-807e-4dc4-8488-752e9d9af4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-49168639-807e-4dc4-8488-752e9d9af4cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:18.799871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:18.800864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:18.801665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 274/544] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:18.808164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc60a95-56c3-483f-abba-9c9a3074d0e6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:18.869643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a842b10-3966-4ab5-95c0-52408908702f None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:18.870329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a842b10-3966-4ab5-95c0-52408908702f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:18.870806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a842b10-3966-4ab5-95c0-52408908702f None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:18.872402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 275/545] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:17:18.877724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c458-3d04-4e68-a707-08b08dc6fa1d None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:18.878373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c458-3d04-4e68-a707-08b08dc6fa1d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:18.878863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c458-3d04-4e68-a707-08b08dc6fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:18.904660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-5220c458-3d04-4e68-a707-08b08dc6fa1d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:18.906229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5220c458-3d04-4e68-a707-08b08dc6fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:18.942509 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc60a95-56c3-483f-abba-9c9a3074d0e6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:18.990143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83299-9cfa-4813-aea4-ae58b6d0a8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:18.990832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83299-9cfa-4813-aea4-ae58b6d0a8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:18.991119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83299-9cfa-4813-aea4-ae58b6d0a8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:18.991400 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83299-9cfa-4813-aea4-ae58b6d0a8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:18.992209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf83299-9cfa-4813-aea4-ae58b6d0a8d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:18.992523 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf83299-9cfa-4813-aea4-ae58b6d0a8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:18.993920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf83299-9cfa-4813-aea4-ae58b6d0a8d2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:19.015141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 271/546] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:19.025216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83299-9cfa-4813-aea4-ae58b6d0a8d2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:19.052926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 276/547] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:19.082255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220c458-3d04-4e68-a707-08b08dc6fa1d None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:19.118576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:19.169681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:19.202846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83299-9cfa-4813-aea4-ae58b6d0a8d2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:19.240614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6c5d0-3802-4ffb-a9af-05a34d628237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:19.241830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c5d0-3802-4ffb-a9af-05a34d628237 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:19.242438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c5d0-3802-4ffb-a9af-05a34d628237 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:19.242933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c5d0-3802-4ffb-a9af-05a34d628237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:19.263445 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6c5d0-3802-4ffb-a9af-05a34d628237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:19.266116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6c5d0-3802-4ffb-a9af-05a34d628237 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:19.274429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220c458-3d04-4e68-a707-08b08dc6fa1d None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d9d6c5d0-3802-4ffb-a9af-05a34d628237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:19.301725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:19.302603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:19.303924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:19.303924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:19.303924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:19.303924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:19.316162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 272/548] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:19.319027 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6c5d0-3802-4ffb-a9af-05a34d628237 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:19.349695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87ec9-d965-4297-993d-d6ed47c642ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:19.350635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87ec9-d965-4297-993d-d6ed47c642ce None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:19.350927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87ec9-d965-4297-993d-d6ed47c642ce None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:19.351213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87ec9-d965-4297-993d-d6ed47c642ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:19.367152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b87ec9-d965-4297-993d-d6ed47c642ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-86b87ec9-d965-4297-993d-d6ed47c642ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:19.381157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:19.382067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:19.382863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:19.383505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 277/549] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:19.389882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87ec9-d965-4297-993d-d6ed47c642ce None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:19.466875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6c5d0-3802-4ffb-a9af-05a34d628237 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:19.489425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:19.505014 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fccb8b-45ac-438e-9c8a-59f3de424410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:19.506060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fccb8b-45ac-438e-9c8a-59f3de424410 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:19.506510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fccb8b-45ac-438e-9c8a-59f3de424410 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:19.510628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fccb8b-45ac-438e-9c8a-59f3de424410 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:19.510628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fccb8b-45ac-438e-9c8a-59f3de424410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:19.510628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fccb8b-45ac-438e-9c8a-59f3de424410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:19.510628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fccb8b-45ac-438e-9c8a-59f3de424410 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:19.523372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 273/550] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:19.530906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fccb8b-45ac-438e-9c8a-59f3de424410 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:19.622555 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87ec9-d965-4297-993d-d6ed47c642ce None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:19.646980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fccb8b-45ac-438e-9c8a-59f3de424410 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:19.660147 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:19.693744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52074b9e-68cc-4601-b75a-1370974137c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:19.694513 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52074b9e-68cc-4601-b75a-1370974137c8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:19.694697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52074b9e-68cc-4601-b75a-1370974137c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:19.694979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52074b9e-68cc-4601-b75a-1370974137c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:19.695738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52074b9e-68cc-4601-b75a-1370974137c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:19.696086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52074b9e-68cc-4601-b75a-1370974137c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:19.697588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52074b9e-68cc-4601-b75a-1370974137c8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:19.718368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 278/551] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:19.720265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a04be-cddb-43eb-99bc-002a4e65fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:19.721080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a04be-cddb-43eb-99bc-002a4e65fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:19.721366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a04be-cddb-43eb-99bc-002a4e65fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:19.721643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a04be-cddb-43eb-99bc-002a4e65fbc9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:19.723291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52074b9e-68cc-4601-b75a-1370974137c8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:19.747698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a04be-cddb-43eb-99bc-002a4e65fbc9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:19.749283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a04be-cddb-43eb-99bc-002a4e65fbc9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-a15a04be-cddb-43eb-99bc-002a4e65fbc9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:19.774414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:19.775391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:19.776369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:19.776369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:19.776369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:19.776369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:19.776369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:19.776369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:19.776369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:19.776369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:19.776369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:19.776369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:19.780327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 274/552] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:19.782073 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a04be-cddb-43eb-99bc-002a4e65fbc9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:19.844634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:19.872059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52074b9e-68cc-4601-b75a-1370974137c8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:19.908195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d081a-be3f-4514-94ff-b4b6d8a65b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:19.909007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d081a-be3f-4514-94ff-b4b6d8a65b3e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:19.909291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d081a-be3f-4514-94ff-b4b6d8a65b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:19.909570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d081a-be3f-4514-94ff-b4b6d8a65b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:19.921167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d081a-be3f-4514-94ff-b4b6d8a65b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:19.922640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d081a-be3f-4514-94ff-b4b6d8a65b3e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-1e8d081a-be3f-4514-94ff-b4b6d8a65b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:19.944930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:19.945842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:19.946688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:19.946688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:19.946688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:19.946688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:19.946688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 279/553] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:19.954890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d081a-be3f-4514-94ff-b4b6d8a65b3e None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:19.984114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a04be-cddb-43eb-99bc-002a4e65fbc9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:19.992458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:20.063884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d081a-be3f-4514-94ff-b4b6d8a65b3e None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:20.073951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9d63-fbd6-4b8e-8966-f87ebcab868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:20.074689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9d63-fbd6-4b8e-8966-f87ebcab868b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.074689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9d63-fbd6-4b8e-8966-f87ebcab868b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.074932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9d63-fbd6-4b8e-8966-f87ebcab868b None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.075725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9d63-fbd6-4b8e-8966-f87ebcab868b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:20.076033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9d63-fbd6-4b8e-8966-f87ebcab868b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:20.077515 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9d63-fbd6-4b8e-8966-f87ebcab868b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:20.102362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54433-63ad-4aba-8c55-1aa594e85802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:20.103106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54433-63ad-4aba-8c55-1aa594e85802 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.103403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54433-63ad-4aba-8c55-1aa594e85802 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.103685 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54433-63ad-4aba-8c55-1aa594e85802 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.104527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54433-63ad-4aba-8c55-1aa594e85802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:20.105418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54433-63ad-4aba-8c55-1aa594e85802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:20.106876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54433-63ad-4aba-8c55-1aa594e85802 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:20.114620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 275/554] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Jun 16 17:17:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:20.120319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9d63-fbd6-4b8e-8966-f87ebcab868b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:20.121402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 280/555] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:20.127672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54433-63ad-4aba-8c55-1aa594e85802 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:20.244790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:20.246421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:20.252859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54433-63ad-4aba-8c55-1aa594e85802 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:20.263653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9d63-fbd6-4b8e-8966-f87ebcab868b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:20.293859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa64ab-51b7-43e3-bcc8-73e3067b3352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:20.294731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa64ab-51b7-43e3-bcc8-73e3067b3352 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.294961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa64ab-51b7-43e3-bcc8-73e3067b3352 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.295235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa64ab-51b7-43e3-bcc8-73e3067b3352 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.303363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66b256-64b5-48ae-b68b-59e1febbe901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:20.304175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa64ab-51b7-43e3-bcc8-73e3067b3352 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:20.304536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66b256-64b5-48ae-b68b-59e1febbe901 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.304967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66b256-64b5-48ae-b68b-59e1febbe901 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.305381 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66b256-64b5-48ae-b68b-59e1febbe901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.305659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa64ab-51b7-43e3-bcc8-73e3067b3352 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-09aa64ab-51b7-43e3-bcc8-73e3067b3352 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:20.322054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:20.324327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:20.325405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 281/556] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:20.325984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb3310-e59f-4b10-9eae-b3e326d6e94d None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.326052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb3310-e59f-4b10-9eae-b3e326d6e94d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.326293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb3310-e59f-4b10-9eae-b3e326d6e94d None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.331927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 282/557] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:20.331927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb3310-e59f-4b10-9eae-b3e326d6e94d None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:20.400353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66b256-64b5-48ae-b68b-59e1febbe901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:20.402329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66b256-64b5-48ae-b68b-59e1febbe901 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:20.444527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb3310-e59f-4b10-9eae-b3e326d6e94d None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:20.478633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518fd43-afd1-48ce-9946-658b97682982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:20.479352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518fd43-afd1-48ce-9946-658b97682982 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.480386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518fd43-afd1-48ce-9946-658b97682982 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.480819 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518fd43-afd1-48ce-9946-658b97682982 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.481660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518fd43-afd1-48ce-9946-658b97682982 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:20.481967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518fd43-afd1-48ce-9946-658b97682982 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:20.483414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518fd43-afd1-48ce-9946-658b97682982 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:20.506076 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:20.512004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 283/558] 10.222.0.77 () {56 vars in 1137 bytes} [Thu Jun 16 17:17:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:20.512004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766853b-bec9-4214-a6b1-bf3d3ab7b263 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.512004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766853b-bec9-4214-a6b1-bf3d3ab7b263 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.512004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766853b-bec9-4214-a6b1-bf3d3ab7b263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.527612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-f766853b-bec9-4214-a6b1-bf3d3ab7b263 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:20.528864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f766853b-bec9-4214-a6b1-bf3d3ab7b263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:20.530912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:20.536737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 276/559] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:17:20.536737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58395e8-3964-461f-8490-cc777b686e8c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.536737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58395e8-3964-461f-8490-cc777b686e8c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.536737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58395e8-3964-461f-8490-cc777b686e8c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.536737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 277/560] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:20.536737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58395e8-3964-461f-8490-cc777b686e8c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:20.620723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 284/561] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:20.620723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766853b-bec9-4214-a6b1-bf3d3ab7b263 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:20.662067 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58395e8-3964-461f-8490-cc777b686e8c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:20.699713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64316b81-3cb5-41ed-a4ac-30991f856c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:20.699921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64316b81-3cb5-41ed-a4ac-30991f856c19 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.700635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64316b81-3cb5-41ed-a4ac-30991f856c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.700920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64316b81-3cb5-41ed-a4ac-30991f856c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.711476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64316b81-3cb5-41ed-a4ac-30991f856c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:20.712951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64316b81-3cb5-41ed-a4ac-30991f856c19 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-64316b81-3cb5-41ed-a4ac-30991f856c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:20.731466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:20.732546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:20.733487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:20.733487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:20.733487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:20.733487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:20.733487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 278/562] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:20.734203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b61b98-dfa0-42ed-8421-f6a9ebf3b78e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.734483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b61b98-dfa0-42ed-8421-f6a9ebf3b78e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.734756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b61b98-dfa0-42ed-8421-f6a9ebf3b78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.735951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766853b-bec9-4214-a6b1-bf3d3ab7b263 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:20.753125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-76b61b98-dfa0-42ed-8421-f6a9ebf3b78e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:20.754454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-76b61b98-dfa0-42ed-8421-f6a9ebf3b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:20.774718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fffe36-e0c4-4e97-9638-cef2113e8f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:20.775391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fffe36-e0c4-4e97-9638-cef2113e8f2f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.775672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fffe36-e0c4-4e97-9638-cef2113e8f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.775948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fffe36-e0c4-4e97-9638-cef2113e8f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.783480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:20.787375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:20.787861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fffe36-e0c4-4e97-9638-cef2113e8f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:20.789872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fffe36-e0c4-4e97-9638-cef2113e8f2f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-21fffe36-e0c4-4e97-9638-cef2113e8f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:20.808086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:20.809180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:20.810050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:20.810050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:20.810050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:20.810050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:20.810050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 285/563] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:20.810319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fffe36-e0c4-4e97-9638-cef2113e8f2f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:20.840006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 279/564] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:20.840006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b61b98-dfa0-42ed-8421-f6a9ebf3b78e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:20.934880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fffe36-e0c4-4e97-9638-cef2113e8f2f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:20.954783 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b61b98-dfa0-42ed-8421-f6a9ebf3b78e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:20.978756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944332ac-4bd3-4d4a-8cfc-c81b604dc607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:20.979629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944332ac-4bd3-4d4a-8cfc-c81b604dc607 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.979915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944332ac-4bd3-4d4a-8cfc-c81b604dc607 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.980466 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944332ac-4bd3-4d4a-8cfc-c81b604dc607 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.991360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944332ac-4bd3-4d4a-8cfc-c81b604dc607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:20.993480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f32e1-5a71-477e-8980-29859b43bc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:20.994147 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f32e1-5a71-477e-8980-29859b43bc44 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:20.994432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f32e1-5a71-477e-8980-29859b43bc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:20.994706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f32e1-5a71-477e-8980-29859b43bc44 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:20.995918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f32e1-5a71-477e-8980-29859b43bc44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:20.996265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f32e1-5a71-477e-8980-29859b43bc44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:20.997632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f32e1-5a71-477e-8980-29859b43bc44 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-944332ac-4bd3-4d4a-8cfc-c81b604dc607 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:21.000226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:21.001219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:21.002044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 286/565] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:21.002722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944332ac-4bd3-4d4a-8cfc-c81b604dc607 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.015996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 280/566] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:21.016851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f32e1-5a71-477e-8980-29859b43bc44 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.045192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:21.054261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:21.102343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944332ac-4bd3-4d4a-8cfc-c81b604dc607 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.115354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f32e1-5a71-477e-8980-29859b43bc44 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.135749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c848ce-68a4-4c10-b3e3-bda96660a76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.136445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c848ce-68a4-4c10-b3e3-bda96660a76d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.136728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c848ce-68a4-4c10-b3e3-bda96660a76d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.137003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c848ce-68a4-4c10-b3e3-bda96660a76d None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.137710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c848ce-68a4-4c10-b3e3-bda96660a76d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:21.138026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c848ce-68a4-4c10-b3e3-bda96660a76d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:21.139910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c848ce-68a4-4c10-b3e3-bda96660a76d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.148684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec887e73-71d0-48aa-bc7f-092fbda16d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.149485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec887e73-71d0-48aa-bc7f-092fbda16d18 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.149789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec887e73-71d0-48aa-bc7f-092fbda16d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.150059 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec887e73-71d0-48aa-bc7f-092fbda16d18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.152168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 287/567] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:21.156637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c848ce-68a4-4c10-b3e3-bda96660a76d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.160252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec887e73-71d0-48aa-bc7f-092fbda16d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ec887e73-71d0-48aa-bc7f-092fbda16d18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:21.168743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:21.169699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:21.170535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 281/568] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:21.171709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d32b9-7856-4797-affa-66d7758313d5 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.171709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d32b9-7856-4797-affa-66d7758313d5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.171709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d32b9-7856-4797-affa-66d7758313d5 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.172941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 282/569] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:21.173618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d32b9-7856-4797-affa-66d7758313d5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.259494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c848ce-68a4-4c10-b3e3-bda96660a76d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.260059 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:21.270288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:21.278344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d32b9-7856-4797-affa-66d7758313d5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.293925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f214638-5ef9-4827-b428-5d393338a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.294589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f214638-5ef9-4827-b428-5d393338a55a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.294863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f214638-5ef9-4827-b428-5d393338a55a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.295132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f214638-5ef9-4827-b428-5d393338a55a None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.295921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f214638-5ef9-4827-b428-5d393338a55a None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:21.296189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f214638-5ef9-4827-b428-5d393338a55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:21.297541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f214638-5ef9-4827-b428-5d393338a55a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.305275 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 288/570] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:21.306044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f214638-5ef9-4827-b428-5d393338a55a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.312472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623225fc-6280-49bd-9c4b-a821cf866598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.313266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623225fc-6280-49bd-9c4b-a821cf866598 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.313545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623225fc-6280-49bd-9c4b-a821cf866598 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.313818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623225fc-6280-49bd-9c4b-a821cf866598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.320524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623225fc-6280-49bd-9c4b-a821cf866598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:21.321965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623225fc-6280-49bd-9c4b-a821cf866598 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-623225fc-6280-49bd-9c4b-a821cf866598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:21.336435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:21.337482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:21.338711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:21.338711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:21.338711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:21.338711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:21.338711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:21.338711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:21.338711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:21.338711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:21.338711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 283/571] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:21.338711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623225fc-6280-49bd-9c4b-a821cf866598 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.408259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f214638-5ef9-4827-b428-5d393338a55a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.438609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623225fc-6280-49bd-9c4b-a821cf866598 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.440962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d6108-92a0-4feb-a992-73917c003454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.441766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d6108-92a0-4feb-a992-73917c003454 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.442044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d6108-92a0-4feb-a992-73917c003454 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.442320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d6108-92a0-4feb-a992-73917c003454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.449116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d6108-92a0-4feb-a992-73917c003454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:21.450719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d6108-92a0-4feb-a992-73917c003454 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-597d6108-92a0-4feb-a992-73917c003454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:21.465262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:21.466277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:21.467250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:21.467250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:21.467250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:21.467250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:21.467250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:21.467250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:21.467250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:21.467250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:21.467250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 289/572] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:21.467739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4943d16-b3fe-4590-83f7-67205e9ba2a8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.467858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4943d16-b3fe-4590-83f7-67205e9ba2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.468192 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4943d16-b3fe-4590-83f7-67205e9ba2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.476889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf6a70-6d76-4748-9310-17fbb5893648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.477571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf6a70-6d76-4748-9310-17fbb5893648 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.477854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf6a70-6d76-4748-9310-17fbb5893648 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.478136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf6a70-6d76-4748-9310-17fbb5893648 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.478877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf6a70-6d76-4748-9310-17fbb5893648 None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:21.479184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf6a70-6d76-4748-9310-17fbb5893648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:21.481259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf6a70-6d76-4748-9310-17fbb5893648 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.484376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d4943d16-b3fe-4590-83f7-67205e9ba2a8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:21.485582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d4943d16-b3fe-4590-83f7-67205e9ba2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:21.489429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 284/573] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:21.490206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf6a70-6d76-4748-9310-17fbb5893648 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.501506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:21.511129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:21.562655 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 290/574] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:21.562655 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4943d16-b3fe-4590-83f7-67205e9ba2a8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.594001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf6a70-6d76-4748-9310-17fbb5893648 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.628100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b257843-950c-4707-97fd-e2d13ea178eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.628901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b257843-950c-4707-97fd-e2d13ea178eb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.629185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b257843-950c-4707-97fd-e2d13ea178eb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.629459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b257843-950c-4707-97fd-e2d13ea178eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.640063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b257843-950c-4707-97fd-e2d13ea178eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:21.641548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b257843-950c-4707-97fd-e2d13ea178eb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7b257843-950c-4707-97fd-e2d13ea178eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:21.659165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:21.660367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:21.661277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:21.661277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:21.661277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:21.661277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:21.661277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 285/575] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:21.661277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b257843-950c-4707-97fd-e2d13ea178eb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.667323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4943d16-b3fe-4590-83f7-67205e9ba2a8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.702410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217ddc6-3a8f-4c9b-9ed9-dd306d0a3a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.703069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217ddc6-3a8f-4c9b-9ed9-dd306d0a3a77 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.703354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217ddc6-3a8f-4c9b-9ed9-dd306d0a3a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.703631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217ddc6-3a8f-4c9b-9ed9-dd306d0a3a77 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.704445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217ddc6-3a8f-4c9b-9ed9-dd306d0a3a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:21.704754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217ddc6-3a8f-4c9b-9ed9-dd306d0a3a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:21.706277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217ddc6-3a8f-4c9b-9ed9-dd306d0a3a77 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.718412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 291/576] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:21.719201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217ddc6-3a8f-4c9b-9ed9-dd306d0a3a77 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.726210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:21.743632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:21.766356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b257843-950c-4707-97fd-e2d13ea178eb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.799658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554129f-6add-4507-a516-bdcfc7953f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.806200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554129f-6add-4507-a516-bdcfc7953f48 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.806200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554129f-6add-4507-a516-bdcfc7953f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.806200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554129f-6add-4507-a516-bdcfc7953f48 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.806200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554129f-6add-4507-a516-bdcfc7953f48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:21.806200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554129f-6add-4507-a516-bdcfc7953f48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:21.806200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554129f-6add-4507-a516-bdcfc7953f48 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.817046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217ddc6-3a8f-4c9b-9ed9-dd306d0a3a77 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.822122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 286/577] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:21.822122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554129f-6add-4507-a516-bdcfc7953f48 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.852209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb0a4e-f6f7-42d5-a86d-e8a7e3285f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.853004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb0a4e-f6f7-42d5-a86d-e8a7e3285f3c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.853283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb0a4e-f6f7-42d5-a86d-e8a7e3285f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:21.853555 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb0a4e-f6f7-42d5-a86d-e8a7e3285f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:21.864837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb0a4e-f6f7-42d5-a86d-e8a7e3285f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:21.866275 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb0a4e-f6f7-42d5-a86d-e8a7e3285f3c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-d5bb0a4e-f6f7-42d5-a86d-e8a7e3285f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:21.884293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:21.885332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:21.886791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:21.886791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:21.886791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:21.886791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:21.886791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 292/578] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:21.887062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb0a4e-f6f7-42d5-a86d-e8a7e3285f3c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:21.963134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554129f-6add-4507-a516-bdcfc7953f48 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:21.983186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:21.997579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474099f-56bb-461f-9af6-ce487a49364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:21.998416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474099f-56bb-461f-9af6-ce487a49364d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:21.998699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474099f-56bb-461f-9af6-ce487a49364d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:22.006372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474099f-56bb-461f-9af6-ce487a49364d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:22.006508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:22.011381 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474099f-56bb-461f-9af6-ce487a49364d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-4474099f-56bb-461f-9af6-ce487a49364d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:22.019617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:22.020593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:22.021413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:22.022058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 287/579] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:22.022185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474099f-56bb-461f-9af6-ce487a49364d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:22.035925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb0a4e-f6f7-42d5-a86d-e8a7e3285f3c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:22.072747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb2f8b-c5a7-4c55-be4b-90b698c09d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:22.073910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb2f8b-c5a7-4c55-be4b-90b698c09d49 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:22.074279 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb2f8b-c5a7-4c55-be4b-90b698c09d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:22.074559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb2f8b-c5a7-4c55-be4b-90b698c09d49 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:22.075270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb2f8b-c5a7-4c55-be4b-90b698c09d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:22.075577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb2f8b-c5a7-4c55-be4b-90b698c09d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:22.076974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb2f8b-c5a7-4c55-be4b-90b698c09d49 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:22.090440 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 293/580] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:22.091046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb2f8b-c5a7-4c55-be4b-90b698c09d49 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:22.125546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474099f-56bb-461f-9af6-ce487a49364d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:22.159606 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2dd37-3373-4cac-b779-b6e3db5d01bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:22.160670 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2dd37-3373-4cac-b779-b6e3db5d01bb None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:22.160956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2dd37-3373-4cac-b779-b6e3db5d01bb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:22.161233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2dd37-3373-4cac-b779-b6e3db5d01bb None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/dff915d0b23d4b9ebd70e6b6b885aca9/roles/2e0782565f884df9ba31ae571e465e25` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:22.175174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2dd37-3373-4cac-b779-b6e3db5d01bb None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=dff915d0b23d4b9ebd70e6b6b885aca9, role_id=2e0782565f884df9ba31ae571e465e25)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:22.176665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2dd37-3373-4cac-b779-b6e3db5d01bb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:22.187894 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb2f8b-c5a7-4c55-be4b-90b698c09d49 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:22.221166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f858d06-2bbb-4227-947a-b3c1fe69cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:22.221811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f858d06-2bbb-4227-947a-b3c1fe69cd78 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:22.222099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f858d06-2bbb-4227-947a-b3c1fe69cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:22.222371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f858d06-2bbb-4227-947a-b3c1fe69cd78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:22.223178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f858d06-2bbb-4227-947a-b3c1fe69cd78 None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=e3c319430309419c895a0dc3c90ce80e) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:22.223476 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f858d06-2bbb-4227-947a-b3c1fe69cd78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:22.224916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f858d06-2bbb-4227-947a-b3c1fe69cd78 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:22.226676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:22.230879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 294/581] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:22 2022] GET /identity/v3/role_assignments?user.id=e3c319430309419c895a0dc3c90ce80e&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:22.231633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f858d06-2bbb-4227-947a-b3c1fe69cd78 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:22.270107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 288/582] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:17:22 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/dff915d0b23d4b9ebd70e6b6b885aca9/roles/2e0782565f884df9ba31ae571e465e25 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:17:22.270341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2dd37-3373-4cac-b779-b6e3db5d01bb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:22.310911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:22.378563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f858d06-2bbb-4227-947a-b3c1fe69cd78 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:22.406618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2dd37-3373-4cac-b779-b6e3db5d01bb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:22.424326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534366-758b-4c8f-89cf-79fa0a919274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:22.424326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534366-758b-4c8f-89cf-79fa0a919274 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:22.424326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534366-758b-4c8f-89cf-79fa0a919274 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:22.424326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2534366-758b-4c8f-89cf-79fa0a919274 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:22.424927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2534366-758b-4c8f-89cf-79fa0a919274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:22.425105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2534366-758b-4c8f-89cf-79fa0a919274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:22.427396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2534366-758b-4c8f-89cf-79fa0a919274 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:22.442883 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 295/583] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:22.443914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534366-758b-4c8f-89cf-79fa0a919274 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:22.455521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fede0-746a-4820-bef5-a0702b87e4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:22.456247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fede0-746a-4820-bef5-a0702b87e4fe None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:22.456584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fede0-746a-4820-bef5-a0702b87e4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:22.456881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fede0-746a-4820-bef5-a0702b87e4fe None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:22.457730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fede0-746a-4820-bef5-a0702b87e4fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:22.458040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fede0-746a-4820-bef5-a0702b87e4fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:22.459481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fede0-746a-4820-bef5-a0702b87e4fe None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:22.470583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 289/584] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:22.471614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fede0-746a-4820-bef5-a0702b87e4fe None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:22.510110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:22.564514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2534366-758b-4c8f-89cf-79fa0a919274 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:22.580461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:22.587883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fede0-746a-4820-bef5-a0702b87e4fe None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:22.606558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae7cec-8f0d-4d01-a4da-526baef07a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:22.607720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7cec-8f0d-4d01-a4da-526baef07a2a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:22.608248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7cec-8f0d-4d01-a4da-526baef07a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:22.608687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7cec-8f0d-4d01-a4da-526baef07a2a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:22.616846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae7cec-8f0d-4d01-a4da-526baef07a2a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:22.618494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae7cec-8f0d-4d01-a4da-526baef07a2a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:22.626592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d04508-6e30-4546-9971-ab8227b8d5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:22.627395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d04508-6e30-4546-9971-ab8227b8d5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:22.627679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d04508-6e30-4546-9971-ab8227b8d5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:22.627957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d04508-6e30-4546-9971-ab8227b8d5c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-9dae7cec-8f0d-4d01-a4da-526baef07a2a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:22.634643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:22.635557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:22.637539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:22.637539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:22.637539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:22.637539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:22.637539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:22.637539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:22.637539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:22.637539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:22.637539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:17:22.637539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:22.638543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d04508-6e30-4546-9971-ab8227b8d5c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:22.638653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 296/585] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:22.642779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d04508-6e30-4546-9971-ab8227b8d5c3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:22.642944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae7cec-8f0d-4d01-a4da-526baef07a2a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d1d04508-6e30-4546-9971-ab8227b8d5c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:22.658613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:22.660527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 290/586] 10.222.0.77 () {56 vars in 1093 bytes} [Thu Jun 16 17:17:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:22.662705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d04508-6e30-4546-9971-ab8227b8d5c3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:22.756539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae7cec-8f0d-4d01-a4da-526baef07a2a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:22.783340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:22.784166 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d04508-6e30-4546-9971-ab8227b8d5c3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:22.807984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decb381-1569-4270-9697-43e10673e875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:22.809415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb381-1569-4270-9697-43e10673e875 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:22.809698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb381-1569-4270-9697-43e10673e875 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:22.810043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb381-1569-4270-9697-43e10673e875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:22.821124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb94a6-cbc2-429c-bd8e-08122d87a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:22.821854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb94a6-cbc2-429c-bd8e-08122d87a74d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:22.822563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb94a6-cbc2-429c-bd8e-08122d87a74d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:22.822861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb94a6-cbc2-429c-bd8e-08122d87a74d None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:22.824721 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb94a6-cbc2-429c-bd8e-08122d87a74d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:22.825058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb94a6-cbc2-429c-bd8e-08122d87a74d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:22.828175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb94a6-cbc2-429c-bd8e-08122d87a74d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:22.828450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decb381-1569-4270-9697-43e10673e875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:22.830204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decb381-1569-4270-9697-43e10673e875 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:22.850087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 291/587] 10.222.0.77 () {56 vars in 1137 bytes} [Thu Jun 16 17:17:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:22.851004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb94a6-cbc2-429c-bd8e-08122d87a74d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-4decb381-1569-4270-9697-43e10673e875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:22.856605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:22.857661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:22.858780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:22.858780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:22.858780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:22.858780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:22.858780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 297/588] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:22.858780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decb381-1569-4270-9697-43e10673e875 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:22.868564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:22.982464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decb381-1569-4270-9697-43e10673e875 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:22.984097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb94a6-cbc2-429c-bd8e-08122d87a74d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:23.020341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067f1fd-56ef-4c39-9f68-55122aac686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:23.021530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f1fd-56ef-4c39-9f68-55122aac686d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:23.021957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f1fd-56ef-4c39-9f68-55122aac686d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:23.022376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f1fd-56ef-4c39-9f68-55122aac686d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:23.027446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c590a8-cfc2-4cdc-a53f-e14af23a7bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:23.028148 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c590a8-cfc2-4cdc-a53f-e14af23a7bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:23.028436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c590a8-cfc2-4cdc-a53f-e14af23a7bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:23.028710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c590a8-cfc2-4cdc-a53f-e14af23a7bd1 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:23.029539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c590a8-cfc2-4cdc-a53f-e14af23a7bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:23.029850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c590a8-cfc2-4cdc-a53f-e14af23a7bd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:23.031282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c590a8-cfc2-4cdc-a53f-e14af23a7bd1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:23.040858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067f1fd-56ef-4c39-9f68-55122aac686d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:23.042946 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067f1fd-56ef-4c39-9f68-55122aac686d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:23.056373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 292/589] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Jun 16 17:17:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:23.061365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c590a8-cfc2-4cdc-a53f-e14af23a7bd1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-6067f1fd-56ef-4c39-9f68-55122aac686d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:23.071575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:23.072682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:23.074036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:23.074036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:23.074036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:23.074036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:23.076824 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 298/590] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:23.078131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067f1fd-56ef-4c39-9f68-55122aac686d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:23.117169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:23.142158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:23.177249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c590a8-cfc2-4cdc-a53f-e14af23a7bd1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:23.215772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324c344-c086-4616-abbc-8cbdc00a15e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:23.216719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324c344-c086-4616-abbc-8cbdc00a15e2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:23.217098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324c344-c086-4616-abbc-8cbdc00a15e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:23.217789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324c344-c086-4616-abbc-8cbdc00a15e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:23.218883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324c344-c086-4616-abbc-8cbdc00a15e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:23.219288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324c344-c086-4616-abbc-8cbdc00a15e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:23.220690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067f1fd-56ef-4c39-9f68-55122aac686d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:23.220827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324c344-c086-4616-abbc-8cbdc00a15e2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:23.238601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 293/591] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:23.238601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324c344-c086-4616-abbc-8cbdc00a15e2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:23.272986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682a2fe-7b34-4f1c-9882-22c614d1fa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:23.274204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682a2fe-7b34-4f1c-9882-22c614d1fa81 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:23.274967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682a2fe-7b34-4f1c-9882-22c614d1fa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:23.275691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682a2fe-7b34-4f1c-9882-22c614d1fa81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:23.290292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682a2fe-7b34-4f1c-9882-22c614d1fa81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:23.293660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682a2fe-7b34-4f1c-9882-22c614d1fa81 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-9682a2fe-7b34-4f1c-9882-22c614d1fa81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:23.314830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:23.315943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:23.317068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:23.317068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:23.317068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:23.317068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:23.322948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 299/592] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:23.324260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682a2fe-7b34-4f1c-9882-22c614d1fa81 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:23.360469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324c344-c086-4616-abbc-8cbdc00a15e2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:23.391763 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:23.406398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3029c-6b7c-4b56-94a2-ec52d2a63f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:23.407206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3029c-6b7c-4b56-94a2-ec52d2a63f80 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:23.407552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3029c-6b7c-4b56-94a2-ec52d2a63f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:23.407888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3029c-6b7c-4b56-94a2-ec52d2a63f80 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:23.409146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3029c-6b7c-4b56-94a2-ec52d2a63f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:23.409146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3029c-6b7c-4b56-94a2-ec52d2a63f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:23.410708 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3029c-6b7c-4b56-94a2-ec52d2a63f80 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:23.412296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:23.427650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 294/593] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:23.428811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3029c-6b7c-4b56-94a2-ec52d2a63f80 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:23.443518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682a2fe-7b34-4f1c-9882-22c614d1fa81 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:23.479274 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72179df-51c8-4233-9097-50f49673ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:23.480923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72179df-51c8-4233-9097-50f49673ad8e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:23.481312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72179df-51c8-4233-9097-50f49673ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:23.481526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72179df-51c8-4233-9097-50f49673ad8e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:23.492759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72179df-51c8-4233-9097-50f49673ad8e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:23.494320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72179df-51c8-4233-9097-50f49673ad8e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-f72179df-51c8-4233-9097-50f49673ad8e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:23.509223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:23.510423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:23.512157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:23.512157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:23.512157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:23.512157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:23.512157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:23.512157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:23.512157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:23.512157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:23.512157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:17:23.512157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:23.518207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 300/594] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:23.519145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72179df-51c8-4233-9097-50f49673ad8e None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:23.568034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3029c-6b7c-4b56-94a2-ec52d2a63f80 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:23.617564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674d08-f98e-4855-a97a-8e093ca3d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:23.618238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674d08-f98e-4855-a97a-8e093ca3d1bd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:23.618524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674d08-f98e-4855-a97a-8e093ca3d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:23.618879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674d08-f98e-4855-a97a-8e093ca3d1bd None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:23.620805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98674d08-f98e-4855-a97a-8e093ca3d1bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:23.621358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98674d08-f98e-4855-a97a-8e093ca3d1bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:23.623249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98674d08-f98e-4855-a97a-8e093ca3d1bd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:23.638533 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 295/595] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:23.640984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674d08-f98e-4855-a97a-8e093ca3d1bd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:23.655325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72179df-51c8-4233-9097-50f49673ad8e None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:23.696422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:23.702890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970441-c225-43ca-bdb2-ea6523a15a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:23.704010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970441-c225-43ca-bdb2-ea6523a15a6e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:23.704337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970441-c225-43ca-bdb2-ea6523a15a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:23.704614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb970441-c225-43ca-bdb2-ea6523a15a6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:23.707249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:23.714353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb970441-c225-43ca-bdb2-ea6523a15a6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:23.715788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb970441-c225-43ca-bdb2-ea6523a15a6e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-eb970441-c225-43ca-bdb2-ea6523a15a6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:23.734352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:23.735254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:23.736166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:23.736166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:23.736166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:23.736166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:23.736166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:23.736166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:23.736166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:23.736166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:23.736166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 301/596] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:23.737105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970441-c225-43ca-bdb2-ea6523a15a6e None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:23.759057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674d08-f98e-4855-a97a-8e093ca3d1bd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:23.801470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec4ef-bfca-4c67-b5ea-bbf8ee782d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:23.802154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec4ef-bfca-4c67-b5ea-bbf8ee782d61 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:23.802552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec4ef-bfca-4c67-b5ea-bbf8ee782d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:23.802833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec4ef-bfca-4c67-b5ea-bbf8ee782d61 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:23.803910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbec4ef-bfca-4c67-b5ea-bbf8ee782d61 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:23.804258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbec4ef-bfca-4c67-b5ea-bbf8ee782d61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:23.806872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbec4ef-bfca-4c67-b5ea-bbf8ee782d61 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:23.832379 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 296/597] 10.222.0.77 () {56 vars in 1139 bytes} [Thu Jun 16 17:17:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:23.833284 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec4ef-bfca-4c67-b5ea-bbf8ee782d61 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:23.863169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb970441-c225-43ca-bdb2-ea6523a15a6e None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:23.911957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b4ebc-8d85-4664-bed5-5e695f8f2263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:23.912838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b4ebc-8d85-4664-bed5-5e695f8f2263 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:23.913121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b4ebc-8d85-4664-bed5-5e695f8f2263 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:23.913396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b4ebc-8d85-4664-bed5-5e695f8f2263 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:23.923445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b4ebc-8d85-4664-bed5-5e695f8f2263 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:23.924926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b4ebc-8d85-4664-bed5-5e695f8f2263 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-ca8b4ebc-8d85-4664-bed5-5e695f8f2263 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:23.944667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:23.945621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:23.946510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:23.946510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:23.946510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:23.946510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:23.946510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:23.946510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:23.946510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:23.946510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:23.948171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 302/598] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:23.950015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b4ebc-8d85-4664-bed5-5e695f8f2263 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:23.962801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec4ef-bfca-4c67-b5ea-bbf8ee782d61 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:23.973521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:24.012979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:24.014480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0690293-933a-4f92-a25a-713396ed93d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:24.015216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0690293-933a-4f92-a25a-713396ed93d5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.015528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0690293-933a-4f92-a25a-713396ed93d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.016382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0690293-933a-4f92-a25a-713396ed93d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.017587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0690293-933a-4f92-a25a-713396ed93d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:24.018082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0690293-933a-4f92-a25a-713396ed93d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:24.019802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0690293-933a-4f92-a25a-713396ed93d5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:24.041521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 297/599] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:24.041521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0690293-933a-4f92-a25a-713396ed93d5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:24.076596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b4ebc-8d85-4664-bed5-5e695f8f2263 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:24.125507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bb3f2-26e7-47d1-83f8-780a85313622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:24.126313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bb3f2-26e7-47d1-83f8-780a85313622 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.126591 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bb3f2-26e7-47d1-83f8-780a85313622 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.126861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bb3f2-26e7-47d1-83f8-780a85313622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.142089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bb3f2-26e7-47d1-83f8-780a85313622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:24.143551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bb3f2-26e7-47d1-83f8-780a85313622 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:24.157921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0690293-933a-4f92-a25a-713396ed93d5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-7c6bb3f2-26e7-47d1-83f8-780a85313622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:24.167604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:24.168799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:24.169678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:24.169678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:24.169678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:24.169678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:24.169678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 303/600] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:24.170304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bb3f2-26e7-47d1-83f8-780a85313622 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:24.197745 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bf410-aeca-457d-9cc7-9e76ea8b80e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:24.199392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bf410-aeca-457d-9cc7-9e76ea8b80e5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.199894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bf410-aeca-457d-9cc7-9e76ea8b80e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.200405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bf410-aeca-457d-9cc7-9e76ea8b80e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.201467 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bf410-aeca-457d-9cc7-9e76ea8b80e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:24.201979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bf410-aeca-457d-9cc7-9e76ea8b80e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:24.203668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bf410-aeca-457d-9cc7-9e76ea8b80e5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:24.222405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 298/601] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:24.223765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bf410-aeca-457d-9cc7-9e76ea8b80e5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:24.253549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:24.299958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bb3f2-26e7-47d1-83f8-780a85313622 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:24.307439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:24.333702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bf410-aeca-457d-9cc7-9e76ea8b80e5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:24.337641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf26dd-511f-429f-8e74-af58e1b2f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:24.338980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf26dd-511f-429f-8e74-af58e1b2f3fb None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.339480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf26dd-511f-429f-8e74-af58e1b2f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.339938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf26dd-511f-429f-8e74-af58e1b2f3fb None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/adf46b0ab3b9400d8fc44ba3a1574f27/roles/2e0782565f884df9ba31ae571e465e25` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.356640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf26dd-511f-429f-8e74-af58e1b2f3fb None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=adf46b0ab3b9400d8fc44ba3a1574f27, role_id=2e0782565f884df9ba31ae571e465e25)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:24.358410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf26dd-511f-429f-8e74-af58e1b2f3fb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:24.373258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69521fea-4397-41df-b1b5-ff90445ebf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:24.375376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69521fea-4397-41df-b1b5-ff90445ebf5e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.375376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69521fea-4397-41df-b1b5-ff90445ebf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.375376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69521fea-4397-41df-b1b5-ff90445ebf5e None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.375376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69521fea-4397-41df-b1b5-ff90445ebf5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:24.375641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69521fea-4397-41df-b1b5-ff90445ebf5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:24.377096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69521fea-4397-41df-b1b5-ff90445ebf5e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:24.391879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 299/602] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:24.392617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69521fea-4397-41df-b1b5-ff90445ebf5e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:24.442840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 304/603] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:17:24 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/adf46b0ab3b9400d8fc44ba3a1574f27/roles/2e0782565f884df9ba31ae571e465e25 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:17:24.444259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf26dd-511f-429f-8e74-af58e1b2f3fb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:24.502731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:24.523118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69521fea-4397-41df-b1b5-ff90445ebf5e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:24.577983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d9a2d-aeaa-4de6-88ef-27712027c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:24.578820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9a2d-aeaa-4de6-88ef-27712027c911 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.579102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9a2d-aeaa-4de6-88ef-27712027c911 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.579380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9a2d-aeaa-4de6-88ef-27712027c911 None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/ba0bb071b7c04e1da55259f079a9c805/roles/2e0782565f884df9ba31ae571e465e25` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.590596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf26dd-511f-429f-8e74-af58e1b2f3fb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:24.599388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d9a2d-aeaa-4de6-88ef-27712027c911 None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=ba0bb071b7c04e1da55259f079a9c805, role_id=2e0782565f884df9ba31ae571e465e25)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:24.601011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d9a2d-aeaa-4de6-88ef-27712027c911 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:24.630241 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e254cb5-33c7-4c71-a614-835669cf06e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:24.631072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e254cb5-33c7-4c71-a614-835669cf06e3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.631352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e254cb5-33c7-4c71-a614-835669cf06e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.631626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e254cb5-33c7-4c71-a614-835669cf06e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.638653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e254cb5-33c7-4c71-a614-835669cf06e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:24.640421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e254cb5-33c7-4c71-a614-835669cf06e3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-2e254cb5-33c7-4c71-a614-835669cf06e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:24.654806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:24.655709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:24.656828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:24.656828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:24.656828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:24.656828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:24.656828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:24.656828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:24.656828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:24.656828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:24.656828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 305/604] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:24.658142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993709cc-577b-4903-8682-780553a940d9 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.658431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993709cc-577b-4903-8682-780553a940d9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.658765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993709cc-577b-4903-8682-780553a940d9 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.660170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 306/605] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:24.661194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becffe69-19cb-4ec2-9276-4cc8852e520b None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.661477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becffe69-19cb-4ec2-9276-4cc8852e520b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.661748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becffe69-19cb-4ec2-9276-4cc8852e520b None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.663017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 307/606] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:24.664027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becffe69-19cb-4ec2-9276-4cc8852e520b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:24.683665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:24.705805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 300/607] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:17:24 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/ba0bb071b7c04e1da55259f079a9c805/roles/2e0782565f884df9ba31ae571e465e25 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:17:24.707802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf379e8-a16a-4aff-bd96-4e7e385863a8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.708254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf379e8-a16a-4aff-bd96-4e7e385863a8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.708664 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf379e8-a16a-4aff-bd96-4e7e385863a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.727269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-cbf379e8-a16a-4aff-bd96-4e7e385863a8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:24.728803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cbf379e8-a16a-4aff-bd96-4e7e385863a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:24.794693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becffe69-19cb-4ec2-9276-4cc8852e520b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:24.830065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 301/608] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:24.832063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6cf98-8245-4f19-9e38-858b72b63929 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.832459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6cf98-8245-4f19-9e38-858b72b63929 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.832816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6cf98-8245-4f19-9e38-858b72b63929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.840589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dba49-8dde-4b13-a668-45a6b1d625f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:24.841723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dba49-8dde-4b13-a668-45a6b1d625f9 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:24.842154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dba49-8dde-4b13-a668-45a6b1d625f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:24.842603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dba49-8dde-4b13-a668-45a6b1d625f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:24.843673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dba49-8dde-4b13-a668-45a6b1d625f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:24.844159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dba49-8dde-4b13-a668-45a6b1d625f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:24.845898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dba49-8dde-4b13-a668-45a6b1d625f9 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:24.854192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-65f6cf98-8245-4f19-9e38-858b72b63929 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:24.856357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-65f6cf98-8245-4f19-9e38-858b72b63929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:24.862003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 308/609] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:24.868144 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dba49-8dde-4b13-a668-45a6b1d625f9 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:24.941185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:24.950296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 302/610] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:24.951277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6cf98-8245-4f19-9e38-858b72b63929 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:24.969416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:25.001981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dba49-8dde-4b13-a668-45a6b1d625f9 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:25.051898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f78b1-8a49-42db-9e0a-18f0bf5c079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:25.053414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f78b1-8a49-42db-9e0a-18f0bf5c079c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:25.053864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f78b1-8a49-42db-9e0a-18f0bf5c079c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:25.054218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f78b1-8a49-42db-9e0a-18f0bf5c079c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:25.061893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6cf98-8245-4f19-9e38-858b72b63929 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:25.069005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f78b1-8a49-42db-9e0a-18f0bf5c079c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-209f78b1-8a49-42db-9e0a-18f0bf5c079c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:25.080565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:25.081628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:25.082628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:25.088093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 309/611] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:25.088093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f78b1-8a49-42db-9e0a-18f0bf5c079c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:25.117705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1574e2-376c-4cf5-9c70-bdcf54c326e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:25.119600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1574e2-376c-4cf5-9c70-bdcf54c326e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:25.120815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1574e2-376c-4cf5-9c70-bdcf54c326e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:25.121654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1574e2-376c-4cf5-9c70-bdcf54c326e0 None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/19ce01cdbd8d4ac9bb126a6814f2d13b/roles/2e0782565f884df9ba31ae571e465e25` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:25.143773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1574e2-376c-4cf5-9c70-bdcf54c326e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=19ce01cdbd8d4ac9bb126a6814f2d13b, role_id=2e0782565f884df9ba31ae571e465e25)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:25.145852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1574e2-376c-4cf5-9c70-bdcf54c326e0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:25.205833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f78b1-8a49-42db-9e0a-18f0bf5c079c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:25.240259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 303/612] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:17:24 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/19ce01cdbd8d4ac9bb126a6814f2d13b/roles/2e0782565f884df9ba31ae571e465e25 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:17:25.241683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1574e2-376c-4cf5-9c70-bdcf54c326e0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:25.267550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ba742-5539-4f04-9e0d-20954fa13c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:25.268885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ba742-5539-4f04-9e0d-20954fa13c5b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:25.269409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ba742-5539-4f04-9e0d-20954fa13c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:25.269903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ba742-5539-4f04-9e0d-20954fa13c5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:25.279834 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:25.301862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ba742-5539-4f04-9e0d-20954fa13c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-370ba742-5539-4f04-9e0d-20954fa13c5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:25.316258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:25.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:25.318646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:25.329869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 310/613] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:25.331015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ba742-5539-4f04-9e0d-20954fa13c5b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:25.354271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:25.471970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1574e2-376c-4cf5-9c70-bdcf54c326e0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:25.495746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ba742-5539-4f04-9e0d-20954fa13c5b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:25.524489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf2a60-6ce5-436d-9479-e1a4e8ab297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:25.526003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf2a60-6ce5-436d-9479-e1a4e8ab297e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:25.527389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf2a60-6ce5-436d-9479-e1a4e8ab297e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:25.527840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf2a60-6ce5-436d-9479-e1a4e8ab297e None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:25.529068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf2a60-6ce5-436d-9479-e1a4e8ab297e None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:25.529968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf2a60-6ce5-436d-9479-e1a4e8ab297e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:25.532062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf2a60-6ce5-436d-9479-e1a4e8ab297e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:25.542378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e651091-9e96-40de-96ac-f2953247e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:25.543210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651091-9e96-40de-96ac-f2953247e819 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:25.543596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651091-9e96-40de-96ac-f2953247e819 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:25.543975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651091-9e96-40de-96ac-f2953247e819 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:25.544875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e651091-9e96-40de-96ac-f2953247e819 None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:25.545280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e651091-9e96-40de-96ac-f2953247e819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:25.545919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 304/614] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:25.550923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf2a60-6ce5-436d-9479-e1a4e8ab297e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:25.551633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e651091-9e96-40de-96ac-f2953247e819 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:25.564857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 311/615] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:25.574639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e651091-9e96-40de-96ac-f2953247e819 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:25.687859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf2a60-6ce5-436d-9479-e1a4e8ab297e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:25.700949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:25.733258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33aeeb-06ca-4383-9af3-dd636c06d174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:25.735294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33aeeb-06ca-4383-9af3-dd636c06d174 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:25.735798 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33aeeb-06ca-4383-9af3-dd636c06d174 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:25.736579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33aeeb-06ca-4383-9af3-dd636c06d174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:25.738225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:25.751126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33aeeb-06ca-4383-9af3-dd636c06d174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:25.753503 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33aeeb-06ca-4383-9af3-dd636c06d174 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ab33aeeb-06ca-4383-9af3-dd636c06d174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:25.778330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:25.779354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:25.780307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:25.780307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:25.780307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:25.780307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:25.787249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 305/616] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:25.790829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33aeeb-06ca-4383-9af3-dd636c06d174 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:25.854986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e651091-9e96-40de-96ac-f2953247e819 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:25.906703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210ad98-2771-485d-9973-7c03638a88a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:25.907543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ad98-2771-485d-9973-7c03638a88a6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:25.907831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ad98-2771-485d-9973-7c03638a88a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:25.908134 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ad98-2771-485d-9973-7c03638a88a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:25.936750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210ad98-2771-485d-9973-7c03638a88a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:25.938859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210ad98-2771-485d-9973-7c03638a88a6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:25.947724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33aeeb-06ca-4383-9af3-dd636c06d174 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b210ad98-2771-485d-9973-7c03638a88a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:25.965443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:25.966373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:25.967284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:25.967284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:25.967284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:25.967284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:25.967284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 312/617] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:25.972599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210ad98-2771-485d-9973-7c03638a88a6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:25.991296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391a9f0-8801-4793-8ef2-7cfadd5e1bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:25.991982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391a9f0-8801-4793-8ef2-7cfadd5e1bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:25.992327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391a9f0-8801-4793-8ef2-7cfadd5e1bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:25.992607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391a9f0-8801-4793-8ef2-7cfadd5e1bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:25.993716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391a9f0-8801-4793-8ef2-7cfadd5e1bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:25.994028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391a9f0-8801-4793-8ef2-7cfadd5e1bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:25.998071 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391a9f0-8801-4793-8ef2-7cfadd5e1bd2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:26.021475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 306/618] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:26.025045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391a9f0-8801-4793-8ef2-7cfadd5e1bd2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:26.069221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:26.136815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210ad98-2771-485d-9973-7c03638a88a6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:26.152547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:26.175188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f5f9e-d622-4f9f-ae5f-75ad7d10e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:26.175865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5f9e-d622-4f9f-ae5f-75ad7d10e615 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:26.176187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5f9e-d622-4f9f-ae5f-75ad7d10e615 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:26.176469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5f9e-d622-4f9f-ae5f-75ad7d10e615 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:26.177212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f5f9e-d622-4f9f-ae5f-75ad7d10e615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:26.177605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f5f9e-d622-4f9f-ae5f-75ad7d10e615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:26.179017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f5f9e-d622-4f9f-ae5f-75ad7d10e615 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:26.197552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 313/619] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:26.199640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f5f9e-d622-4f9f-ae5f-75ad7d10e615 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:26.278942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391a9f0-8801-4793-8ef2-7cfadd5e1bd2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:26.339820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f5f9e-d622-4f9f-ae5f-75ad7d10e615 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:26.349704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998f988-8079-45de-b4c5-8e6bdfd54d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:26.350664 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998f988-8079-45de-b4c5-8e6bdfd54d26 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:26.351018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998f988-8079-45de-b4c5-8e6bdfd54d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:26.351301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998f988-8079-45de-b4c5-8e6bdfd54d26 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:26.363410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998f988-8079-45de-b4c5-8e6bdfd54d26 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:26.369208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998f988-8079-45de-b4c5-8e6bdfd54d26 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:26.377920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e903090-790a-4776-974d-9a4b84cecf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:26.378790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903090-790a-4776-974d-9a4b84cecf47 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:26.379077 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903090-790a-4776-974d-9a4b84cecf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:26.379357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903090-790a-4776-974d-9a4b84cecf47 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:26.396105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e903090-790a-4776-974d-9a4b84cecf47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:26.396105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e903090-790a-4776-974d-9a4b84cecf47 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2998f988-8079-45de-b4c5-8e6bdfd54d26 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:26.396962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:26.397869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:26.398833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:26.398833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:26.398833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:26.398833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:26.398833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:26.398833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:26.398833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:26.398833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:26.398833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:26.398833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:26.401270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 307/620] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-2e903090-790a-4776-974d-9a4b84cecf47 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:26.406398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:26.407318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:26.408282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:26.408282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:26.408282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:26.408282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:26.408282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:26.408282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:26.408282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:26.408282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:26.408282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 17:17:26.408282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:26.409536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998f988-8079-45de-b4c5-8e6bdfd54d26 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:26.412242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 314/621] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:26.413527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e903090-790a-4776-974d-9a4b84cecf47 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:26.447410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:26.544198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e903090-790a-4776-974d-9a4b84cecf47 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:26.582717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc5b8c-ec66-4da6-8f40-de1a4c332306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:26.583451 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc5b8c-ec66-4da6-8f40-de1a4c332306 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:26.583786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc5b8c-ec66-4da6-8f40-de1a4c332306 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:26.584091 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc5b8c-ec66-4da6-8f40-de1a4c332306 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:26.588104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc5b8c-ec66-4da6-8f40-de1a4c332306 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:26.588104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc5b8c-ec66-4da6-8f40-de1a4c332306 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:26.588104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc5b8c-ec66-4da6-8f40-de1a4c332306 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:26.613416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 315/622] 10.222.0.77 () {56 vars in 1137 bytes} [Thu Jun 16 17:17:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:26.614771 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc5b8c-ec66-4da6-8f40-de1a4c332306 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:26.643895 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:26.726062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998f988-8079-45de-b4c5-8e6bdfd54d26 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:26.728340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:26.740604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc5b8c-ec66-4da6-8f40-de1a4c332306 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:26.782708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189bed6-cb42-45d7-a270-4f5ca78f082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:26.783536 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189bed6-cb42-45d7-a270-4f5ca78f082c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:26.783901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189bed6-cb42-45d7-a270-4f5ca78f082c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:26.784288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189bed6-cb42-45d7-a270-4f5ca78f082c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:26.861664 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9cf3-5978-4f1e-adfb-06d5bbd36b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:26.862278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9cf3-5978-4f1e-adfb-06d5bbd36b39 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:26.862564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9cf3-5978-4f1e-adfb-06d5bbd36b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:26.862834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9cf3-5978-4f1e-adfb-06d5bbd36b39 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:26.863680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9cf3-5978-4f1e-adfb-06d5bbd36b39 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:26.863994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9cf3-5978-4f1e-adfb-06d5bbd36b39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:26.865517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9cf3-5978-4f1e-adfb-06d5bbd36b39 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:26.868250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189bed6-cb42-45d7-a270-4f5ca78f082c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:26.870066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189bed6-cb42-45d7-a270-4f5ca78f082c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:26.922465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 308/623] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Jun 16 17:17:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:26.927805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9cf3-5978-4f1e-adfb-06d5bbd36b39 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:26.988133 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:27.008155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 316/624] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 17:17:27.009799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5956-7b98-4da7-9b2a-9ba7df071f92 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.011071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5956-7b98-4da7-9b2a-9ba7df071f92 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.011552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5956-7b98-4da7-9b2a-9ba7df071f92 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.018411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 317/625] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:27.018411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c5956-7b98-4da7-9b2a-9ba7df071f92 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:27.074498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9cf3-5978-4f1e-adfb-06d5bbd36b39 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:27.116319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35141827-189b-40f6-a6d5-5673583e6381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:27.117039 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35141827-189b-40f6-a6d5-5673583e6381 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.117316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35141827-189b-40f6-a6d5-5673583e6381 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.117590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35141827-189b-40f6-a6d5-5673583e6381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.125564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:27.129325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35141827-189b-40f6-a6d5-5673583e6381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:27.130763 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35141827-189b-40f6-a6d5-5673583e6381 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-35141827-189b-40f6-a6d5-5673583e6381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:27.149015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:27.150168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:27.152966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:27.152966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:27.152966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:27.152966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:27.152966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 309/626] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:27.152966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16681eb2-e457-4260-8099-0cbffd747256 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.152966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16681eb2-e457-4260-8099-0cbffd747256 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.153376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16681eb2-e457-4260-8099-0cbffd747256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.168770 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c5956-7b98-4da7-9b2a-9ba7df071f92 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:27.171751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-16681eb2-e457-4260-8099-0cbffd747256 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:27.173154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-16681eb2-e457-4260-8099-0cbffd747256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:27.212352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841d83e-f11e-4ea7-8b40-68e41e3b0fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:27.213166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d83e-f11e-4ea7-8b40-68e41e3b0fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.213683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d83e-f11e-4ea7-8b40-68e41e3b0fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.214369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d83e-f11e-4ea7-8b40-68e41e3b0fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.225456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841d83e-f11e-4ea7-8b40-68e41e3b0fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:27.226887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841d83e-f11e-4ea7-8b40-68e41e3b0fc5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-5841d83e-f11e-4ea7-8b40-68e41e3b0fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:27.245594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:27.246556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:27.247510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:27.247510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:27.247510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:27.247510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:27.247510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 318/627] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:27.248273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6f34a-36ce-41a2-88b6-8b432fe8d520 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.248577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6f34a-36ce-41a2-88b6-8b432fe8d520 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.248785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6f34a-36ce-41a2-88b6-8b432fe8d520 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.250216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 319/628] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:27.254545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6f34a-36ce-41a2-88b6-8b432fe8d520 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:27.260338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 310/629] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:27.269559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16681eb2-e457-4260-8099-0cbffd747256 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:27.303720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:27.364154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6f34a-36ce-41a2-88b6-8b432fe8d520 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:27.381403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16681eb2-e457-4260-8099-0cbffd747256 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:27.400655 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78755c22-5199-4c06-ac4a-05ad0ad30e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:27.401380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755c22-5199-4c06-ac4a-05ad0ad30e26 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.401661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755c22-5199-4c06-ac4a-05ad0ad30e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.401931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755c22-5199-4c06-ac4a-05ad0ad30e26 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.402873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:27.403306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78755c22-5199-4c06-ac4a-05ad0ad30e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:27.403757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78755c22-5199-4c06-ac4a-05ad0ad30e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:27.405166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78755c22-5199-4c06-ac4a-05ad0ad30e26 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:27.418060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 320/630] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:27.418361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786ec2b-d5ac-4a48-a320-5c6ba365889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:27.420964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786ec2b-d5ac-4a48-a320-5c6ba365889b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.421077 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d23136-3e6b-41ce-8043-91fbaed0531b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.421171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786ec2b-d5ac-4a48-a320-5c6ba365889b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.421244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d23136-3e6b-41ce-8043-91fbaed0531b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.421313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786ec2b-d5ac-4a48-a320-5c6ba365889b None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.421391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d23136-3e6b-41ce-8043-91fbaed0531b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.421472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786ec2b-d5ac-4a48-a320-5c6ba365889b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:27.421472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786ec2b-d5ac-4a48-a320-5c6ba365889b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:27.423139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786ec2b-d5ac-4a48-a320-5c6ba365889b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:27.435439 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 311/631] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:27.436540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786ec2b-d5ac-4a48-a320-5c6ba365889b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:27.441174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-69d23136-3e6b-41ce-8043-91fbaed0531b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:27.442372 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-69d23136-3e6b-41ce-8043-91fbaed0531b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:27.523954 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 321/632] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:27.525055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d23136-3e6b-41ce-8043-91fbaed0531b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:27.559464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786ec2b-d5ac-4a48-a320-5c6ba365889b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:27.574262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:27.600431 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9d50b-956f-42c9-9adb-86e44f8dc644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:27.601236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9d50b-956f-42c9-9adb-86e44f8dc644 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.601513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9d50b-956f-42c9-9adb-86e44f8dc644 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.601786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9d50b-956f-42c9-9adb-86e44f8dc644 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.612418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9d50b-956f-42c9-9adb-86e44f8dc644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-4ad9d50b-956f-42c9-9adb-86e44f8dc644 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:27.620762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:27.621686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:27.622520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:27.626736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 312/633] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:27.627410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9d50b-956f-42c9-9adb-86e44f8dc644 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:27.650089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d23136-3e6b-41ce-8043-91fbaed0531b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:27.670641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:27.687620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa6353-eb01-439b-87b3-e4a850a44688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:27.688452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa6353-eb01-439b-87b3-e4a850a44688 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.688909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa6353-eb01-439b-87b3-e4a850a44688 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.689041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa6353-eb01-439b-87b3-e4a850a44688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.695958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa6353-eb01-439b-87b3-e4a850a44688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:27.697474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa6353-eb01-439b-87b3-e4a850a44688 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-bbfa6353-eb01-439b-87b3-e4a850a44688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:27.712388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:27.713400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:27.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:27.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:27.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:27.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:27.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:27.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:27.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:27.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:27.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 322/634] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:27.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa6353-eb01-439b-87b3-e4a850a44688 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:27.740142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9d50b-956f-42c9-9adb-86e44f8dc644 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:27.777686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200bd96-22f4-4ada-bfae-dccfa6d9b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:27.778501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200bd96-22f4-4ada-bfae-dccfa6d9b853 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.778788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200bd96-22f4-4ada-bfae-dccfa6d9b853 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.779066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200bd96-22f4-4ada-bfae-dccfa6d9b853 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.786760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200bd96-22f4-4ada-bfae-dccfa6d9b853 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:27.788237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200bd96-22f4-4ada-bfae-dccfa6d9b853 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d200bd96-22f4-4ada-bfae-dccfa6d9b853 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:27.802447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:27.803372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:27.804301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:27.804301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:27.804301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:27.804301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:27.804301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:27.804301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:27.804301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:27.804301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:27.804301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 313/635] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:27.804781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200bd96-22f4-4ada-bfae-dccfa6d9b853 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:27.818553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:27.827922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa6353-eb01-439b-87b3-e4a850a44688 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:27.861208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bca82-2fb8-44b7-8c13-6fcfcc3662e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:27.862000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bca82-2fb8-44b7-8c13-6fcfcc3662e4 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.862284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bca82-2fb8-44b7-8c13-6fcfcc3662e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.862556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bca82-2fb8-44b7-8c13-6fcfcc3662e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.873268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bca82-2fb8-44b7-8c13-6fcfcc3662e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-a21bca82-2fb8-44b7-8c13-6fcfcc3662e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:27.881512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:27.882549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:27.883369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 323/636] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:27.884200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bca82-2fb8-44b7-8c13-6fcfcc3662e4 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:27.904933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:27.907657 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200bd96-22f4-4ada-bfae-dccfa6d9b853 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:27.941103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bdd2b-a7bd-44cc-8abb-d223599a376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:27.941834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bdd2b-a7bd-44cc-8abb-d223599a376d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.942123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bdd2b-a7bd-44cc-8abb-d223599a376d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.942401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bdd2b-a7bd-44cc-8abb-d223599a376d None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.943134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bdd2b-a7bd-44cc-8abb-d223599a376d None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:27.943444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bdd2b-a7bd-44cc-8abb-d223599a376d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:27.944839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bdd2b-a7bd-44cc-8abb-d223599a376d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:27.953644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 314/637] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:27.954919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3e6d6-a4c5-453d-84d6-f38c533cb1f2 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:27.955210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3e6d6-a4c5-453d-84d6-f38c533cb1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:27.955494 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3e6d6-a4c5-453d-84d6-f38c533cb1f2 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:27.956768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 315/638] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:27.957459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3e6d6-a4c5-453d-84d6-f38c533cb1f2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:27.991027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bca82-2fb8-44b7-8c13-6fcfcc3662e4 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:28.024632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7346277-2ad8-4c8e-b161-180cb579b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:28.025291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7346277-2ad8-4c8e-b161-180cb579b027 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.025571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7346277-2ad8-4c8e-b161-180cb579b027 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.025845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7346277-2ad8-4c8e-b161-180cb579b027 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.026711 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7346277-2ad8-4c8e-b161-180cb579b027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:28.027013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7346277-2ad8-4c8e-b161-180cb579b027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:28.028462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7346277-2ad8-4c8e-b161-180cb579b027 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:28.039774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 324/639] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:28.040592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7346277-2ad8-4c8e-b161-180cb579b027 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:28.055007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:28.065525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3e6d6-a4c5-453d-84d6-f38c533cb1f2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:28.100000 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f874fc-9f07-418f-ab68-795ad148e3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:28.100695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f874fc-9f07-418f-ab68-795ad148e3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.101012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f874fc-9f07-418f-ab68-795ad148e3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.101299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f874fc-9f07-418f-ab68-795ad148e3d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.102071 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f874fc-9f07-418f-ab68-795ad148e3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:28.102381 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f874fc-9f07-418f-ab68-795ad148e3d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:28.103859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f874fc-9f07-418f-ab68-795ad148e3d0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:28.116920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 316/640] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:28.117721 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f874fc-9f07-418f-ab68-795ad148e3d0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:28.141109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7346277-2ad8-4c8e-b161-180cb579b027 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:28.143129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:28.175040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94001fcc-f93e-47e2-befa-c70a09b9faa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:28.175649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001fcc-f93e-47e2-befa-c70a09b9faa3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.175938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001fcc-f93e-47e2-befa-c70a09b9faa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.176435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001fcc-f93e-47e2-befa-c70a09b9faa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.177177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94001fcc-f93e-47e2-befa-c70a09b9faa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:28.177490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94001fcc-f93e-47e2-befa-c70a09b9faa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:28.178853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94001fcc-f93e-47e2-befa-c70a09b9faa3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:28.186829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 325/641] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:28.188011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a60b5-9246-478b-9e07-3bb5102d9dc7 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.188333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a60b5-9246-478b-9e07-3bb5102d9dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.188615 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a60b5-9246-478b-9e07-3bb5102d9dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.204301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ee9a60b5-9246-478b-9e07-3bb5102d9dc7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:28.205479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ee9a60b5-9246-478b-9e07-3bb5102d9dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:28.223276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f874fc-9f07-418f-ab68-795ad148e3d0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:28.258030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaf323-1f91-4e26-9fca-cf8506fc5f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:28.258832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf323-1f91-4e26-9fca-cf8506fc5f95 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.259118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf323-1f91-4e26-9fca-cf8506fc5f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.259399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf323-1f91-4e26-9fca-cf8506fc5f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.270775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaf323-1f91-4e26-9fca-cf8506fc5f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:28.272325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaf323-1f91-4e26-9fca-cf8506fc5f95 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:28.273629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 326/642] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:28.274437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a60b5-9246-478b-9e07-3bb5102d9dc7 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:28.276642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-59eaf323-1f91-4e26-9fca-cf8506fc5f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:28.289894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:28.291102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:28.292374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:28.292374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:28.292374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:28.292374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:28.296109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 317/643] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:28.296969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaf323-1f91-4e26-9fca-cf8506fc5f95 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:28.371515 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:28.385071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a60b5-9246-478b-9e07-3bb5102d9dc7 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:28.395969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaf323-1f91-4e26-9fca-cf8506fc5f95 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:28.420588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65198541-43f6-4b33-b2dd-23dc7daacd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:28.421481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65198541-43f6-4b33-b2dd-23dc7daacd85 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.421764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65198541-43f6-4b33-b2dd-23dc7daacd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.422040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65198541-43f6-4b33-b2dd-23dc7daacd85 None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/e3c319430309419c895a0dc3c90ce80e/roles/2e0782565f884df9ba31ae571e465e25` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.429828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac64d86-33ba-4544-82d8-0075415926af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:28.430480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac64d86-33ba-4544-82d8-0075415926af None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.430763 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac64d86-33ba-4544-82d8-0075415926af None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.431037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac64d86-33ba-4544-82d8-0075415926af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.431846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac64d86-33ba-4544-82d8-0075415926af None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=dff915d0b23d4b9ebd70e6b6b885aca9) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:28.432714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac64d86-33ba-4544-82d8-0075415926af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:28.434248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac64d86-33ba-4544-82d8-0075415926af None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:28.436826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65198541-43f6-4b33-b2dd-23dc7daacd85 None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=e3c319430309419c895a0dc3c90ce80e, role_id=2e0782565f884df9ba31ae571e465e25)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:28.438248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65198541-43f6-4b33-b2dd-23dc7daacd85 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:28.450013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 318/644] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:28 2022] GET /identity/v3/role_assignments?user.id=dff915d0b23d4b9ebd70e6b6b885aca9&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:28.450013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac64d86-33ba-4544-82d8-0075415926af None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:28.544113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 327/645] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:17:28 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/e3c319430309419c895a0dc3c90ce80e/roles/2e0782565f884df9ba31ae571e465e25 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:17:28.544113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65198541-43f6-4b33-b2dd-23dc7daacd85 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:28.573873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac64d86-33ba-4544-82d8-0075415926af None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:28.627726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f8da-7c06-41f3-b966-739c6c8a6628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:28.628590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f8da-7c06-41f3-b966-739c6c8a6628 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.628904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f8da-7c06-41f3-b966-739c6c8a6628 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.630042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:28.630813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f8da-7c06-41f3-b966-739c6c8a6628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.641633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:28.645900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17f8da-7c06-41f3-b966-739c6c8a6628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:28.647702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17f8da-7c06-41f3-b966-739c6c8a6628 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6d17f8da-7c06-41f3-b966-739c6c8a6628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:28.670018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:28.670987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:28.672336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:28.672336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:28.672336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:28.672336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:28.672336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 319/646] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:28.672336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f8da-7c06-41f3-b966-739c6c8a6628 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:28.708855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65198541-43f6-4b33-b2dd-23dc7daacd85 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:28.753725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91866a5-774b-400b-9215-b48ce1c53a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:28.754661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91866a5-774b-400b-9215-b48ce1c53a72 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.754948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91866a5-774b-400b-9215-b48ce1c53a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.755228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91866a5-774b-400b-9215-b48ce1c53a72 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.755960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91866a5-774b-400b-9215-b48ce1c53a72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:28.756314 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91866a5-774b-400b-9215-b48ce1c53a72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:28.757699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91866a5-774b-400b-9215-b48ce1c53a72 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:28.771587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 328/647] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:28.772526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91866a5-774b-400b-9215-b48ce1c53a72 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:28.802465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f8da-7c06-41f3-b966-739c6c8a6628 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:28.842545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1f669-0028-4d68-b7be-6c5b151d39ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:28.843370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1f669-0028-4d68-b7be-6c5b151d39ed None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.843666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1f669-0028-4d68-b7be-6c5b151d39ed None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.844003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1f669-0028-4d68-b7be-6c5b151d39ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.857352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1f669-0028-4d68-b7be-6c5b151d39ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-4fb1f669-0028-4d68-b7be-6c5b151d39ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:28.866057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:28.866986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:28.867790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 320/648] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:28.868952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1f669-0028-4d68-b7be-6c5b151d39ed None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:28.878930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91866a5-774b-400b-9215-b48ce1c53a72 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:28.893947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:28.916390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbdfa-2e0f-42a1-9a1d-52c2111b5c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:28.917483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbdfa-2e0f-42a1-9a1d-52c2111b5c32 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:28.917816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbdfa-2e0f-42a1-9a1d-52c2111b5c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:28.918186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbdfa-2e0f-42a1-9a1d-52c2111b5c32 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:28.919277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dbdfa-2e0f-42a1-9a1d-52c2111b5c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:28.919798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dbdfa-2e0f-42a1-9a1d-52c2111b5c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:28.921665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dbdfa-2e0f-42a1-9a1d-52c2111b5c32 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:28.940065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 329/649] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:28.940065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbdfa-2e0f-42a1-9a1d-52c2111b5c32 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:28.994474 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:29.000627 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1f669-0028-4d68-b7be-6c5b151d39ed None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.040818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b731-e2cb-4137-a31d-d4148b4a4aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.042724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b731-e2cb-4137-a31d-d4148b4a4aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.042893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbdfa-2e0f-42a1-9a1d-52c2111b5c32 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.043720 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b731-e2cb-4137-a31d-d4148b4a4aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.044335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b731-e2cb-4137-a31d-d4148b4a4aa4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.055793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6b731-e2cb-4137-a31d-d4148b4a4aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.058336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6b731-e2cb-4137-a31d-d4148b4a4aa4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-eda6b731-e2cb-4137-a31d-d4148b4a4aa4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:29.077737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:29.078768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:29.079717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:29.079717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:29.079717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:29.079717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:29.079717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:29.079717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:29.079717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:29.079717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:29.079717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:17:29.079717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:29.080302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a4846-5390-4143-a1cf-1034d816c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.080302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4846-5390-4143-a1cf-1034d816c7bc None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.080472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4846-5390-4143-a1cf-1034d816c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.080738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4846-5390-4143-a1cf-1034d816c7bc None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.081451 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a4846-5390-4143-a1cf-1034d816c7bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:29.081760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a4846-5390-4143-a1cf-1034d816c7bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.082834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 321/650] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:29.083198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a4846-5390-4143-a1cf-1034d816c7bc None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.084145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b731-e2cb-4137-a31d-d4148b4a4aa4 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:29.093735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 330/651] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:29.094689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a4846-5390-4143-a1cf-1034d816c7bc None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:29.130246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:29.198831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a4846-5390-4143-a1cf-1034d816c7bc None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.202486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b731-e2cb-4137-a31d-d4148b4a4aa4 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.213866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:29.233519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4275-a87f-4523-a552-24f9ad8a32dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.234256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4275-a87f-4523-a552-24f9ad8a32dc None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.234538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4275-a87f-4523-a552-24f9ad8a32dc None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.234810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4275-a87f-4523-a552-24f9ad8a32dc None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.235638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a4275-a87f-4523-a552-24f9ad8a32dc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:29.235948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a4275-a87f-4523-a552-24f9ad8a32dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.237431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a4275-a87f-4523-a552-24f9ad8a32dc None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.241858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbe1ee-5c29-432e-ac5b-f07b6d8040e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.242842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbe1ee-5c29-432e-ac5b-f07b6d8040e7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.243282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbe1ee-5c29-432e-ac5b-f07b6d8040e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.243728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbe1ee-5c29-432e-ac5b-f07b6d8040e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.253158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbe1ee-5c29-432e-ac5b-f07b6d8040e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.254877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbe1ee-5c29-432e-ac5b-f07b6d8040e7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.257609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 331/652] 10.222.0.77 () {56 vars in 1137 bytes} [Thu Jun 16 17:17:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:29.258633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4275-a87f-4523-a552-24f9ad8a32dc None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-01bbe1ee-5c29-432e-ac5b-f07b6d8040e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:29.273970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:29.275366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:29.276854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:29.276854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:29.276854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:29.276854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:29.276854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:29.276854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:29.276854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:29.276854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:29.276854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:29.276854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:29.279193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 322/653] 10.222.0.77 () {56 vars in 1093 bytes} [Thu Jun 16 17:17:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:29.280214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbe1ee-5c29-432e-ac5b-f07b6d8040e7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:29.357557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:29.366494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4275-a87f-4523-a552-24f9ad8a32dc None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.395384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbe1ee-5c29-432e-ac5b-f07b6d8040e7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.404055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5a0ce-33b9-4978-a88e-e4eedc7df56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.404908 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5a0ce-33b9-4978-a88e-e4eedc7df56b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.405201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5a0ce-33b9-4978-a88e-e4eedc7df56b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.405487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5a0ce-33b9-4978-a88e-e4eedc7df56b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.416215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5a0ce-33b9-4978-a88e-e4eedc7df56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.418225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5a0ce-33b9-4978-a88e-e4eedc7df56b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.434717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523d0c6-410a-47b3-a627-8cf8aaccf370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.435574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523d0c6-410a-47b3-a627-8cf8aaccf370 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.436011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523d0c6-410a-47b3-a627-8cf8aaccf370 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.436465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523d0c6-410a-47b3-a627-8cf8aaccf370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-a1c5a0ce-33b9-4978-a88e-e4eedc7df56b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:29.442462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:29.443519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:29.444646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:29.444646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:29.444646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:29.444646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:29.450636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 332/654] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:29.450636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5a0ce-33b9-4978-a88e-e4eedc7df56b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:29.485249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:29.516537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523d0c6-410a-47b3-a627-8cf8aaccf370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.520018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523d0c6-410a-47b3-a627-8cf8aaccf370 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.552441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5a0ce-33b9-4978-a88e-e4eedc7df56b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.588944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5f73c-e542-4154-8904-4bd9cdf32c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.589506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5f73c-e542-4154-8904-4bd9cdf32c40 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.589888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5f73c-e542-4154-8904-4bd9cdf32c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.590265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5f73c-e542-4154-8904-4bd9cdf32c40 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.591195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5f73c-e542-4154-8904-4bd9cdf32c40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:29.591609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5f73c-e542-4154-8904-4bd9cdf32c40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.593159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5f73c-e542-4154-8904-4bd9cdf32c40 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.611915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 333/655] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Jun 16 17:17:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:29.613022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5f73c-e542-4154-8904-4bd9cdf32c40 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:29.615683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:29.637005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 323/656] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:29.638136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523d0c6-410a-47b3-a627-8cf8aaccf370 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:29.714686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:29.720154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5f73c-e542-4154-8904-4bd9cdf32c40 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.751622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523d0c6-410a-47b3-a627-8cf8aaccf370 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.758758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a11e3-3ffb-402b-9eae-7b8385ed51cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.759571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a11e3-3ffb-402b-9eae-7b8385ed51cf None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.759973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a11e3-3ffb-402b-9eae-7b8385ed51cf None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.760577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a11e3-3ffb-402b-9eae-7b8385ed51cf None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.761537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a11e3-3ffb-402b-9eae-7b8385ed51cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:29.761947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a11e3-3ffb-402b-9eae-7b8385ed51cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.763557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a11e3-3ffb-402b-9eae-7b8385ed51cf None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.781156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 334/657] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:29.781156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a11e3-3ffb-402b-9eae-7b8385ed51cf None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:29.799975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441364cb-34e5-47c6-ab04-9d63a25533ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.800971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441364cb-34e5-47c6-ab04-9d63a25533ad None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.801444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441364cb-34e5-47c6-ab04-9d63a25533ad None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.801929 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441364cb-34e5-47c6-ab04-9d63a25533ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.846699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:29.879586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441364cb-34e5-47c6-ab04-9d63a25533ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.881432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441364cb-34e5-47c6-ab04-9d63a25533ad None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.887557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a11e3-3ffb-402b-9eae-7b8385ed51cf None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:29.924015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb927ace-197c-45dd-b9ba-eb27b6163938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:29.924844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb927ace-197c-45dd-b9ba-eb27b6163938 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:29.925130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb927ace-197c-45dd-b9ba-eb27b6163938 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:29.925410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb927ace-197c-45dd-b9ba-eb27b6163938 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:29.936905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb927ace-197c-45dd-b9ba-eb27b6163938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:29.938347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb927ace-197c-45dd-b9ba-eb27b6163938 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-bb927ace-197c-45dd-b9ba-eb27b6163938 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:29.956366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:29.957253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:29.958135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:29.958135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:29.958135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:29.958135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:29.958135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 335/658] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:29.958878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb927ace-197c-45dd-b9ba-eb27b6163938 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:29.963941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:29.999770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 324/659] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:30.001392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441364cb-34e5-47c6-ab04-9d63a25533ad None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:30.083423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb927ace-197c-45dd-b9ba-eb27b6163938 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:30.098507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:30.116141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441364cb-34e5-47c6-ab04-9d63a25533ad None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:30.128355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db06af9-5d20-4caa-8138-2cd08c8f819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:30.129571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db06af9-5d20-4caa-8138-2cd08c8f819b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.129836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db06af9-5d20-4caa-8138-2cd08c8f819b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.130119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db06af9-5d20-4caa-8138-2cd08c8f819b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.141833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db06af9-5d20-4caa-8138-2cd08c8f819b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:30.144266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db06af9-5d20-4caa-8138-2cd08c8f819b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:30.155870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0dad9-7d2f-4b81-837f-eb4b37c3870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:30.156582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0dad9-7d2f-4b81-837f-eb4b37c3870c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.156897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0dad9-7d2f-4b81-837f-eb4b37c3870c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.157174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0dad9-7d2f-4b81-837f-eb4b37c3870c None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.157891 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0dad9-7d2f-4b81-837f-eb4b37c3870c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:30.158223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0dad9-7d2f-4b81-837f-eb4b37c3870c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:30.159693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0dad9-7d2f-4b81-837f-eb4b37c3870c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-3db06af9-5d20-4caa-8138-2cd08c8f819b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:30.160618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:30.161517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:30.162442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 336/660] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:30.163550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db06af9-5d20-4caa-8138-2cd08c8f819b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:30.173413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 325/661] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:30.174413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0dad9-7d2f-4b81-837f-eb4b37c3870c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:30.209723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:30.272904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db06af9-5d20-4caa-8138-2cd08c8f819b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:30.293471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0dad9-7d2f-4b81-837f-eb4b37c3870c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:30.314453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658365a-3ecf-425e-a240-aa7bd11cad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:30.315502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658365a-3ecf-425e-a240-aa7bd11cad70 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.315934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658365a-3ecf-425e-a240-aa7bd11cad70 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.316543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658365a-3ecf-425e-a240-aa7bd11cad70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.328716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658365a-3ecf-425e-a240-aa7bd11cad70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:30.330695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658365a-3ecf-425e-a240-aa7bd11cad70 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:30.332131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f790e-fc79-43ed-a52c-f1875481cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:30.332926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f790e-fc79-43ed-a52c-f1875481cc5d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.333212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f790e-fc79-43ed-a52c-f1875481cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.333551 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f790e-fc79-43ed-a52c-f1875481cc5d None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.334508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f790e-fc79-43ed-a52c-f1875481cc5d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:30.334749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f790e-fc79-43ed-a52c-f1875481cc5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:30.336275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f790e-fc79-43ed-a52c-f1875481cc5d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-8658365a-3ecf-425e-a240-aa7bd11cad70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:30.350913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:30.351986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:30.353006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:30.353006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:30.353006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:30.353006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:30.355252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 337/662] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:30.356299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658365a-3ecf-425e-a240-aa7bd11cad70 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:30.361486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 326/663] 10.222.0.77 () {56 vars in 1139 bytes} [Thu Jun 16 17:17:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:30.362501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f790e-fc79-43ed-a52c-f1875481cc5d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:30.388571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:30.466852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:30.471877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658365a-3ecf-425e-a240-aa7bd11cad70 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:30.481595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f790e-fc79-43ed-a52c-f1875481cc5d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:30.509715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec63be-931e-4308-b0ca-56f89f65870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:30.511675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec63be-931e-4308-b0ca-56f89f65870d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.512279 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec63be-931e-4308-b0ca-56f89f65870d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.512774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec63be-931e-4308-b0ca-56f89f65870d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.521278 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec63be-931e-4308-b0ca-56f89f65870d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:30.522942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b787631-f6b4-4634-b94a-f4f4d1e38d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:30.523362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec63be-931e-4308-b0ca-56f89f65870d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:30.523678 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b787631-f6b4-4634-b94a-f4f4d1e38d1b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.523964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b787631-f6b4-4634-b94a-f4f4d1e38d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.524287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b787631-f6b4-4634-b94a-f4f4d1e38d1b None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.525005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b787631-f6b4-4634-b94a-f4f4d1e38d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:30.525315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b787631-f6b4-4634-b94a-f4f4d1e38d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:30.527461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b787631-f6b4-4634-b94a-f4f4d1e38d1b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-24ec63be-931e-4308-b0ca-56f89f65870d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:30.539867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:30.540776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:30.541736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:30.541736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:30.541736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:30.541736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:30.541736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:30.541736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:30.541736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:30.541736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:30.547426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 327/664] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:30.548101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 338/665] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:30.549265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b787631-f6b4-4634-b94a-f4f4d1e38d1b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:30.550754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec63be-931e-4308-b0ca-56f89f65870d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:30.660970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:30.666940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b787631-f6b4-4634-b94a-f4f4d1e38d1b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:30.679663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec63be-931e-4308-b0ca-56f89f65870d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:30.710157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2514a-7924-422e-aa10-693526a4966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:30.710157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2514a-7924-422e-aa10-693526a4966a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.710481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2514a-7924-422e-aa10-693526a4966a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.710724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2514a-7924-422e-aa10-693526a4966a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.727557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61454-fa27-4eba-9150-a9d497d19918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:30.728854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61454-fa27-4eba-9150-a9d497d19918 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.729757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61454-fa27-4eba-9150-a9d497d19918 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.730394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61454-fa27-4eba-9150-a9d497d19918 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.731740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc61454-fa27-4eba-9150-a9d497d19918 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:30.732414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc61454-fa27-4eba-9150-a9d497d19918 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:30.733873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:30.735807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc61454-fa27-4eba-9150-a9d497d19918 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:30.751941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 339/666] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:30.753317 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61454-fa27-4eba-9150-a9d497d19918 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:30.790521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2514a-7924-422e-aa10-693526a4966a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:30.792898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2514a-7924-422e-aa10-693526a4966a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:30.883532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61454-fa27-4eba-9150-a9d497d19918 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:30.909145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 328/667] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:30.909995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2514a-7924-422e-aa10-693526a4966a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:30.920347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681836f-d67c-4782-93c5-b603df04d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:30.921078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681836f-d67c-4782-93c5-b603df04d0be None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.921365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681836f-d67c-4782-93c5-b603df04d0be None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.921647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681836f-d67c-4782-93c5-b603df04d0be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.928479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681836f-d67c-4782-93c5-b603df04d0be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:30.929936 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681836f-d67c-4782-93c5-b603df04d0be None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-6681836f-d67c-4782-93c5-b603df04d0be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:30.945582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:30.946662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:30.947552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:30.947552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:30.947552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:30.947552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:30.947552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:30.947552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:30.947552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:30.947552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:30.947552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 340/668] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:30.948999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2296-4f19-4cc0-8c98-026817f25211 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.948999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2296-4f19-4cc0-8c98-026817f25211 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.949127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2296-4f19-4cc0-8c98-026817f25211 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.950502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 341/669] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:30.952973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf74d4-0373-442f-a6cf-179fea953c60 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:30.953265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf74d4-0373-442f-a6cf-179fea953c60 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:30.953544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf74d4-0373-442f-a6cf-179fea953c60 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:30.954787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 342/670] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:30.955482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf74d4-0373-442f-a6cf-179fea953c60 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:30.962400 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:30.965078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:31.014957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2514a-7924-422e-aa10-693526a4966a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:31.050360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e668a3-e5ff-40d5-9416-6bebb9b34057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:31.051109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e668a3-e5ff-40d5-9416-6bebb9b34057 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.051405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e668a3-e5ff-40d5-9416-6bebb9b34057 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.051680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e668a3-e5ff-40d5-9416-6bebb9b34057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.052528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e668a3-e5ff-40d5-9416-6bebb9b34057 None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=adf46b0ab3b9400d8fc44ba3a1574f27) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:31.052840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e668a3-e5ff-40d5-9416-6bebb9b34057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:31.054295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e668a3-e5ff-40d5-9416-6bebb9b34057 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:31.060283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 329/671] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:30 2022] GET /identity/v3/role_assignments?user.id=adf46b0ab3b9400d8fc44ba3a1574f27&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:31.060400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf74d4-0373-442f-a6cf-179fea953c60 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:31.061115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e668a3-e5ff-40d5-9416-6bebb9b34057 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:31.109602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405e7bd-ddbe-423b-8406-5d3b43a1c62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:31.110480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405e7bd-ddbe-423b-8406-5d3b43a1c62e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.110769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405e7bd-ddbe-423b-8406-5d3b43a1c62e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.111046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405e7bd-ddbe-423b-8406-5d3b43a1c62e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.124668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405e7bd-ddbe-423b-8406-5d3b43a1c62e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:31.126203 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405e7bd-ddbe-423b-8406-5d3b43a1c62e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-4405e7bd-ddbe-423b-8406-5d3b43a1c62e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:31.146999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:31.148108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:31.149059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:31.149059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:31.149059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:31.149059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:31.149059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 343/672] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:31.150614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384aba3-999f-42d8-b56f-c3e0db711033 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.150614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384aba3-999f-42d8-b56f-c3e0db711033 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.150614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384aba3-999f-42d8-b56f-c3e0db711033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.169563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-0384aba3-999f-42d8-b56f-c3e0db711033 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:31.170854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0384aba3-999f-42d8-b56f-c3e0db711033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:31.185778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e668a3-e5ff-40d5-9416-6bebb9b34057 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:31.202483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:31.225386 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a4234-a05f-435f-9d26-098b687822c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:31.226168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a4234-a05f-435f-9d26-098b687822c9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.226446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a4234-a05f-435f-9d26-098b687822c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.226728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a4234-a05f-435f-9d26-098b687822c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.227508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a4234-a05f-435f-9d26-098b687822c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:31.227821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a4234-a05f-435f-9d26-098b687822c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:31.229329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a4234-a05f-435f-9d26-098b687822c9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:31.232854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:31.245598 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 330/673] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:31.246955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eddf4-2d20-441c-928c-228db85390a7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.247255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eddf4-2d20-441c-928c-228db85390a7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.247539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eddf4-2d20-441c-928c-228db85390a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.253132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 344/674] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:31.254974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384aba3-999f-42d8-b56f-c3e0db711033 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:31.266192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-403eddf4-2d20-441c-928c-228db85390a7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:31.267581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-403eddf4-2d20-441c-928c-228db85390a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:31.351395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 331/675] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:31.352275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eddf4-2d20-441c-928c-228db85390a7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:31.380323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384aba3-999f-42d8-b56f-c3e0db711033 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:31.417637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0bae4-b32f-4e08-bb56-25beea92c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:31.418284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0bae4-b32f-4e08-bb56-25beea92c820 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.418567 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0bae4-b32f-4e08-bb56-25beea92c820 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.418857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0bae4-b32f-4e08-bb56-25beea92c820 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.419769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0bae4-b32f-4e08-bb56-25beea92c820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:31.419875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0bae4-b32f-4e08-bb56-25beea92c820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:31.421305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0bae4-b32f-4e08-bb56-25beea92c820 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:31.438864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 345/676] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:31.438864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0bae4-b32f-4e08-bb56-25beea92c820 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:31.477171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eddf4-2d20-441c-928c-228db85390a7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:31.478753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:31.492526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:31.518535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae18a3-42ef-43e1-898a-c752f3212458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:31.519211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae18a3-42ef-43e1-898a-c752f3212458 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.519495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae18a3-42ef-43e1-898a-c752f3212458 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.519775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae18a3-42ef-43e1-898a-c752f3212458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.520867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae18a3-42ef-43e1-898a-c752f3212458 None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=ba0bb071b7c04e1da55259f079a9c805) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:31.520974 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae18a3-42ef-43e1-898a-c752f3212458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:31.522370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae18a3-42ef-43e1-898a-c752f3212458 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:31.536181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 332/677] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:31 2022] GET /identity/v3/role_assignments?user.id=ba0bb071b7c04e1da55259f079a9c805&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:31.536181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae18a3-42ef-43e1-898a-c752f3212458 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:31.556629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0bae4-b32f-4e08-bb56-25beea92c820 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:31.605376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248cc29-1e2a-435a-b6c5-921805424c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:31.606402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248cc29-1e2a-435a-b6c5-921805424c8f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.606795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248cc29-1e2a-435a-b6c5-921805424c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.607180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248cc29-1e2a-435a-b6c5-921805424c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.620856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248cc29-1e2a-435a-b6c5-921805424c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:31.622566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248cc29-1e2a-435a-b6c5-921805424c8f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-d248cc29-1e2a-435a-b6c5-921805424c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:31.642445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:31.643608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:31.644741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:31.644741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:31.644741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:31.644741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:31.650876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 346/678] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:31.651975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248cc29-1e2a-435a-b6c5-921805424c8f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:31.709633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae18a3-42ef-43e1-898a-c752f3212458 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:31.759379 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf1d1f-7f75-4333-b024-c5819dbc2c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:31.760722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf1d1f-7f75-4333-b024-c5819dbc2c83 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.761019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf1d1f-7f75-4333-b024-c5819dbc2c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.761304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf1d1f-7f75-4333-b024-c5819dbc2c83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.772914 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf1d1f-7f75-4333-b024-c5819dbc2c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:31.777156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:31.780145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248cc29-1e2a-435a-b6c5-921805424c8f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-3edf1d1f-7f75-4333-b024-c5819dbc2c83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:31.782290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:31.783213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:31.784042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 333/679] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:31.785181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf1d1f-7f75-4333-b024-c5819dbc2c83 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:31.823221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:31.834929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07462e50-8e08-44f5-ac0a-27b564ec187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:31.834929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462e50-8e08-44f5-ac0a-27b564ec187b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.834929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462e50-8e08-44f5-ac0a-27b564ec187b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.834929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462e50-8e08-44f5-ac0a-27b564ec187b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.846816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07462e50-8e08-44f5-ac0a-27b564ec187b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:31.849514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07462e50-8e08-44f5-ac0a-27b564ec187b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-07462e50-8e08-44f5-ac0a-27b564ec187b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:31.871316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:31.872321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:31.873329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:31.873329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:31.873329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:31.873329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:31.873329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:31.873329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:31.873329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:31.873329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:31.873815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 347/680] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:31.878987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07462e50-8e08-44f5-ac0a-27b564ec187b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:31.924471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf1d1f-7f75-4333-b024-c5819dbc2c83 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:31.965151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22948c4f-57e0-4ed3-983d-268a952f8b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:31.966162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22948c4f-57e0-4ed3-983d-268a952f8b9e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:31.966697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22948c4f-57e0-4ed3-983d-268a952f8b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:31.967236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22948c4f-57e0-4ed3-983d-268a952f8b9e None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:31.968184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22948c4f-57e0-4ed3-983d-268a952f8b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:31.968724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22948c4f-57e0-4ed3-983d-268a952f8b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:31.970308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22948c4f-57e0-4ed3-983d-268a952f8b9e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:31.984058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 334/681] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:31.990136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22948c4f-57e0-4ed3-983d-268a952f8b9e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:32.002263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07462e50-8e08-44f5-ac0a-27b564ec187b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:32.041115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fda02-5bee-4944-b6ef-908a3012b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:32.041684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fda02-5bee-4944-b6ef-908a3012b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:32.041684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fda02-5bee-4944-b6ef-908a3012b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:32.042305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fda02-5bee-4944-b6ef-908a3012b1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:32.042958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fda02-5bee-4944-b6ef-908a3012b1f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:32.043262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fda02-5bee-4944-b6ef-908a3012b1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:32.044775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fda02-5bee-4944-b6ef-908a3012b1f0 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:32.054096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 348/682] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:32.054871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fda02-5bee-4944-b6ef-908a3012b1f0 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:32.083248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:32.117115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:32.139695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22948c4f-57e0-4ed3-983d-268a952f8b9e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:32.172959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fda02-5bee-4944-b6ef-908a3012b1f0 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:32.186775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32130138-a530-447a-9af9-fe7c513d8e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:32.187444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32130138-a530-447a-9af9-fe7c513d8e75 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:32.187724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32130138-a530-447a-9af9-fe7c513d8e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:32.188023 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32130138-a530-447a-9af9-fe7c513d8e75 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:32.188820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32130138-a530-447a-9af9-fe7c513d8e75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:32.189129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32130138-a530-447a-9af9-fe7c513d8e75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:32.190548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32130138-a530-447a-9af9-fe7c513d8e75 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:32.204355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 335/683] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:32.204355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32130138-a530-447a-9af9-fe7c513d8e75 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:32.224580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e08dd2-2eb3-4c57-99b4-3c3942ad1aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:32.225172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e08dd2-2eb3-4c57-99b4-3c3942ad1aee None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:32.225455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e08dd2-2eb3-4c57-99b4-3c3942ad1aee None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:32.225781 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e08dd2-2eb3-4c57-99b4-3c3942ad1aee None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:32.226484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e08dd2-2eb3-4c57-99b4-3c3942ad1aee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:32.228099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e08dd2-2eb3-4c57-99b4-3c3942ad1aee None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:32.329505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32130138-a530-447a-9af9-fe7c513d8e75 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:32.349131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 349/684] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:17:32 2022] POST /identity/v3/users => generated 254 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:32.350778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e08dd2-2eb3-4c57-99b4-3c3942ad1aee None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:32.408642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b5d4a-0b85-475b-a282-dff71515b970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:32.409464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b5d4a-0b85-475b-a282-dff71515b970 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:32.409745 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b5d4a-0b85-475b-a282-dff71515b970 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:32.410022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b5d4a-0b85-475b-a282-dff71515b970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:32.439765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b5d4a-0b85-475b-a282-dff71515b970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:32.441279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b5d4a-0b85-475b-a282-dff71515b970 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:32.457359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b95b5d4a-0b85-475b-a282-dff71515b970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:32.472886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:32.476294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:32.477199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:32.477199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:32.477199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:32.477199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:32.479520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 336/685] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:32.485726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b5d4a-0b85-475b-a282-dff71515b970 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:32.544579 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:32.575096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e08dd2-2eb3-4c57-99b4-3c3942ad1aee None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:32.616556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27f6a-fb6a-450b-9ff0-0ef20025c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:32.617251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27f6a-fb6a-450b-9ff0-0ef20025c794 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:32.617539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27f6a-fb6a-450b-9ff0-0ef20025c794 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:32.617815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27f6a-fb6a-450b-9ff0-0ef20025c794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:32.619063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a27f6a-fb6a-450b-9ff0-0ef20025c794 None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=19ce01cdbd8d4ac9bb126a6814f2d13b) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:32.619380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a27f6a-fb6a-450b-9ff0-0ef20025c794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:32.621295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a27f6a-fb6a-450b-9ff0-0ef20025c794 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:32.629234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 350/686] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:32 2022] GET /identity/v3/role_assignments?user.id=19ce01cdbd8d4ac9bb126a6814f2d13b&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:32.655917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b5d4a-0b85-475b-a282-dff71515b970 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:32.708609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272751a6-3be3-4f30-9ba2-7f7b1051c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:32.709313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272751a6-3be3-4f30-9ba2-7f7b1051c153 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:32.709601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272751a6-3be3-4f30-9ba2-7f7b1051c153 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:32.709881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272751a6-3be3-4f30-9ba2-7f7b1051c153 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:32.710622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272751a6-3be3-4f30-9ba2-7f7b1051c153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:32.710934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272751a6-3be3-4f30-9ba2-7f7b1051c153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:32.712366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272751a6-3be3-4f30-9ba2-7f7b1051c153 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:32.731965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 337/687] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:32.737695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27f6a-fb6a-450b-9ff0-0ef20025c794 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:32.860362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27f6a-fb6a-450b-9ff0-0ef20025c794 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:32.903129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8457c32-c3aa-44da-aa63-768a9bab2894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:32.903952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8457c32-c3aa-44da-aa63-768a9bab2894 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:32.904270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8457c32-c3aa-44da-aa63-768a9bab2894 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:32.904552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8457c32-c3aa-44da-aa63-768a9bab2894 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:32.915167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8457c32-c3aa-44da-aa63-768a9bab2894 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:32.916771 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8457c32-c3aa-44da-aa63-768a9bab2894 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-d8457c32-c3aa-44da-aa63-768a9bab2894 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:32.932931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:32.935268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:32.937516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 351/688] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:32.946061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272751a6-3be3-4f30-9ba2-7f7b1051c153 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:33.017479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:33.062463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272751a6-3be3-4f30-9ba2-7f7b1051c153 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:33.100175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423b7e5-7e9e-419d-8673-418169fce64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:33.100857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423b7e5-7e9e-419d-8673-418169fce64d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:33.101137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423b7e5-7e9e-419d-8673-418169fce64d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:33.101414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423b7e5-7e9e-419d-8673-418169fce64d None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:33.102240 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423b7e5-7e9e-419d-8673-418169fce64d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:33.102544 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423b7e5-7e9e-419d-8673-418169fce64d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:33.104531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423b7e5-7e9e-419d-8673-418169fce64d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:33.124095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 338/689] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Jun 16 17:17:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:33.130730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8457c32-c3aa-44da-aa63-768a9bab2894 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:33.137808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:33.257133 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8457c32-c3aa-44da-aa63-768a9bab2894 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:33.299456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a7e43-df5a-4710-8a2c-330e2c3659d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:33.300515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a7e43-df5a-4710-8a2c-330e2c3659d8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:33.301026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a7e43-df5a-4710-8a2c-330e2c3659d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:33.301509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a7e43-df5a-4710-8a2c-330e2c3659d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:33.324758 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d440b6-16f0-4425-a112-6e96d270bdae None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:33.325069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d440b6-16f0-4425-a112-6e96d270bdae None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:33.325311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d440b6-16f0-4425-a112-6e96d270bdae None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:33.326898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 339/690] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:33.332105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d5c0-5928-41cf-b74f-0d8a38f11604 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:33.332406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d5c0-5928-41cf-b74f-0d8a38f11604 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:33.332682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d5c0-5928-41cf-b74f-0d8a38f11604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:33.349461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5a15d5c0-5928-41cf-b74f-0d8a38f11604 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:33.350644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5a15d5c0-5928-41cf-b74f-0d8a38f11604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:33.379117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a7e43-df5a-4710-8a2c-330e2c3659d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:33.380928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a7e43-df5a-4710-8a2c-330e2c3659d8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:33.383014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:33.483863 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 340/691] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:17:33.490381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 352/692] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:33.500114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d5c0-5928-41cf-b74f-0d8a38f11604 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:33.520528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a7e43-df5a-4710-8a2c-330e2c3659d8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:33.580431 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:33.635902 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d5c0-5928-41cf-b74f-0d8a38f11604 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:33.673624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1f6fd-7356-4b17-8835-5cc66cf8a5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:33.674496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f6fd-7356-4b17-8835-5cc66cf8a5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:33.674780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f6fd-7356-4b17-8835-5cc66cf8a5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:33.675050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f6fd-7356-4b17-8835-5cc66cf8a5f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:33.685802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1f6fd-7356-4b17-8835-5cc66cf8a5f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:33.687257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1f6fd-7356-4b17-8835-5cc66cf8a5f9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-dae1f6fd-7356-4b17-8835-5cc66cf8a5f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:33.705173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:33.706072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:33.706961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:33.706961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:33.706961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:33.706961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:33.706961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 341/693] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:33.713858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1f6fd-7356-4b17-8835-5cc66cf8a5f9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:33.777929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a7e43-df5a-4710-8a2c-330e2c3659d8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:33.780373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:33.848952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855cf95-95ea-4c87-a6c4-3af5c711039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:33.849831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855cf95-95ea-4c87-a6c4-3af5c711039b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:33.850120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855cf95-95ea-4c87-a6c4-3af5c711039b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:33.850382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855cf95-95ea-4c87-a6c4-3af5c711039b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:33.851041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855cf95-95ea-4c87-a6c4-3af5c711039b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:33.852435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855cf95-95ea-4c87-a6c4-3af5c711039b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-2855cf95-95ea-4c87-a6c4-3af5c711039b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:33.879394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:33.880454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:17:33.881286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:33.882599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 353/694] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Jun 16 17:17:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:33.888443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855cf95-95ea-4c87-a6c4-3af5c711039b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:33.891196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:33.897361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1f6fd-7356-4b17-8835-5cc66cf8a5f9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:33.996808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98d820-3fa8-4642-af53-e2bc14507cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:33.997496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d820-3fa8-4642-af53-e2bc14507cce None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:33.997778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d820-3fa8-4642-af53-e2bc14507cce None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:33.998055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d820-3fa8-4642-af53-e2bc14507cce None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:33.998778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98d820-3fa8-4642-af53-e2bc14507cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:33.999083 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98d820-3fa8-4642-af53-e2bc14507cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:34.001445 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98d820-3fa8-4642-af53-e2bc14507cce None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:34.023215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 342/695] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:34.028808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98d820-3fa8-4642-af53-e2bc14507cce None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:34.051867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855cf95-95ea-4c87-a6c4-3af5c711039b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:34.097348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3b543-1541-44df-aa6e-f4b433d85409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:34.098024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b543-1541-44df-aa6e-f4b433d85409 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.098309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b543-1541-44df-aa6e-f4b433d85409 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.098584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b543-1541-44df-aa6e-f4b433d85409 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.099506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3b543-1541-44df-aa6e-f4b433d85409 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:34.099762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3b543-1541-44df-aa6e-f4b433d85409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:34.101942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3b543-1541-44df-aa6e-f4b433d85409 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:34.108593 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 354/696] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Jun 16 17:17:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:34.109855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4fc74-7ee4-4822-85d9-8a16de16ed93 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.110144 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4fc74-7ee4-4822-85d9-8a16de16ed93 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.110423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4fc74-7ee4-4822-85d9-8a16de16ed93 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.111894 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 355/697] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:34.116714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4fc74-7ee4-4822-85d9-8a16de16ed93 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:34.145496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98d820-3fa8-4642-af53-e2bc14507cce None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:34.157532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:34.180311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a41d3c-38f5-481e-a7ce-58e4f8412ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:34.180938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a41d3c-38f5-481e-a7ce-58e4f8412ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.181270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a41d3c-38f5-481e-a7ce-58e4f8412ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.181546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a41d3c-38f5-481e-a7ce-58e4f8412ba7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.189506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a41d3c-38f5-481e-a7ce-58e4f8412ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:34.191019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a41d3c-38f5-481e-a7ce-58e4f8412ba7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b3a41d3c-38f5-481e-a7ce-58e4f8412ba7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:34.207250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:34.208329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:34.209413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:34.209413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:34.209413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:34.209413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:34.209413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:34.209413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:34.209413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:34.209413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:34.209413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 343/698] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:34.210018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092967-3a5f-4350-806a-3cf2e45835dd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.210308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092967-3a5f-4350-806a-3cf2e45835dd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.211360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092967-3a5f-4350-806a-3cf2e45835dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.228580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5e092967-3a5f-4350-806a-3cf2e45835dd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:34.230003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5e092967-3a5f-4350-806a-3cf2e45835dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:34.245337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:34.251950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4fc74-7ee4-4822-85d9-8a16de16ed93 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:34.299365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bbd90-f5be-4d2d-b8a8-06344fb3a9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:34.300838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bbd90-f5be-4d2d-b8a8-06344fb3a9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.301221 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bbd90-f5be-4d2d-b8a8-06344fb3a9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.301596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bbd90-f5be-4d2d-b8a8-06344fb3a9e2 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.302516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bbd90-f5be-4d2d-b8a8-06344fb3a9e2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:34.303197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bbd90-f5be-4d2d-b8a8-06344fb3a9e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:34.304590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bbd90-f5be-4d2d-b8a8-06344fb3a9e2 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:34.315859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 344/699] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:34.315859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e092967-3a5f-4350-806a-3cf2e45835dd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:34.318255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 356/700] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Jun 16 17:17:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:34.341204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bbd90-f5be-4d2d-b8a8-06344fb3a9e2 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:34.492902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bbd90-f5be-4d2d-b8a8-06344fb3a9e2 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:34.502680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:34.523552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e092967-3a5f-4350-806a-3cf2e45835dd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:34.533310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f054387-314b-42dd-b167-e9a13e4c42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:34.534409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054387-314b-42dd-b167-e9a13e4c42db None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.534896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054387-314b-42dd-b167-e9a13e4c42db None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.535399 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054387-314b-42dd-b167-e9a13e4c42db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.549643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f054387-314b-42dd-b167-e9a13e4c42db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-8f054387-314b-42dd-b167-e9a13e4c42db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:34.558921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:34.559876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:34.560796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:34.561998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 357/701] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:34.569517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f054387-314b-42dd-b167-e9a13e4c42db None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:34.575097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cb892-dbef-4d7a-b6dc-78d984b4fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:34.575097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cb892-dbef-4d7a-b6dc-78d984b4fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.575097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cb892-dbef-4d7a-b6dc-78d984b4fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.575500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cb892-dbef-4d7a-b6dc-78d984b4fcf0 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.577592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cb892-dbef-4d7a-b6dc-78d984b4fcf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:34.577905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cb892-dbef-4d7a-b6dc-78d984b4fcf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:34.579336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cb892-dbef-4d7a-b6dc-78d984b4fcf0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:34.598366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 345/702] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:34.603650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cb892-dbef-4d7a-b6dc-78d984b4fcf0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:34.619846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:34.743108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f054387-314b-42dd-b167-e9a13e4c42db None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:34.790544 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cb892-dbef-4d7a-b6dc-78d984b4fcf0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:34.821308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515283a-f31c-4b97-ac55-c297f6f64d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:34.822044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515283a-f31c-4b97-ac55-c297f6f64d4d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.822332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515283a-f31c-4b97-ac55-c297f6f64d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.823138 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515283a-f31c-4b97-ac55-c297f6f64d4d None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.824050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515283a-f31c-4b97-ac55-c297f6f64d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:34.824501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515283a-f31c-4b97-ac55-c297f6f64d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:34.826040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515283a-f31c-4b97-ac55-c297f6f64d4d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:34.834287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5823b-5e27-46df-8cfc-686a232f119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:34.835207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5823b-5e27-46df-8cfc-686a232f119d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:34.835644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5823b-5e27-46df-8cfc-686a232f119d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:34.836124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5823b-5e27-46df-8cfc-686a232f119d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:34.837148 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5823b-5e27-46df-8cfc-686a232f119d None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=e3c319430309419c895a0dc3c90ce80e) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:34.838808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5823b-5e27-46df-8cfc-686a232f119d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:34.841415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5823b-5e27-46df-8cfc-686a232f119d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:34.843519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 358/703] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:34.848994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 346/704] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:34 2022] GET /identity/v3/role_assignments?user.id=e3c319430309419c895a0dc3c90ce80e&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:34.849900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515283a-f31c-4b97-ac55-c297f6f64d4d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:34.880489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:34.973899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515283a-f31c-4b97-ac55-c297f6f64d4d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:35.015649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a755b1f-92ae-4985-88ac-1d67fb0dbf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:35.016847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a755b1f-92ae-4985-88ac-1d67fb0dbf60 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.017348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a755b1f-92ae-4985-88ac-1d67fb0dbf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.017807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a755b1f-92ae-4985-88ac-1d67fb0dbf60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.031529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a755b1f-92ae-4985-88ac-1d67fb0dbf60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:35.033333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a755b1f-92ae-4985-88ac-1d67fb0dbf60 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-1a755b1f-92ae-4985-88ac-1d67fb0dbf60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:35.054462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:35.055468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:35.056454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:35.056454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:35.056454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:35.056454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:35.059541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 359/705] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:35.065011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5823b-5e27-46df-8cfc-686a232f119d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:35.178139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:35.209371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188d85b-4050-4911-9edd-5b05aa9873ec None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.209715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188d85b-4050-4911-9edd-5b05aa9873ec None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.210041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188d85b-4050-4911-9edd-5b05aa9873ec None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.215502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 360/706] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:35.215644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5823b-5e27-46df-8cfc-686a232f119d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:35.219250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb485e-65f4-4ffc-84ab-000b273655e9 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.219542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb485e-65f4-4ffc-84ab-000b273655e9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.219825 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb485e-65f4-4ffc-84ab-000b273655e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.239279 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-b0eb485e-65f4-4ffc-84ab-000b273655e9 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:35.240575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b0eb485e-65f4-4ffc-84ab-000b273655e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:35.253507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76570c-978e-48b2-b8f6-a29a3f08d018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:35.254498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76570c-978e-48b2-b8f6-a29a3f08d018 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.255052 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76570c-978e-48b2-b8f6-a29a3f08d018 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.255554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76570c-978e-48b2-b8f6-a29a3f08d018 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.256497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76570c-978e-48b2-b8f6-a29a3f08d018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:35.257008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76570c-978e-48b2-b8f6-a29a3f08d018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:35.258859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76570c-978e-48b2-b8f6-a29a3f08d018 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:35.273171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 347/707] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:35.280716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76570c-978e-48b2-b8f6-a29a3f08d018 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:35.317884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:35.332256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 361/708] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:35.353654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb485e-65f4-4ffc-84ab-000b273655e9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:35.401267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76570c-978e-48b2-b8f6-a29a3f08d018 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:35.442884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f9a7b-ba71-4c27-8288-cd291257d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:35.442884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9a7b-ba71-4c27-8288-cd291257d968 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.442884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9a7b-ba71-4c27-8288-cd291257d968 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.443246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9a7b-ba71-4c27-8288-cd291257d968 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.445514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:35.453048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f9a7b-ba71-4c27-8288-cd291257d968 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:35.454546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f9a7b-ba71-4c27-8288-cd291257d968 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-649f9a7b-ba71-4c27-8288-cd291257d968 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:35.470953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:35.471934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:35.472930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:35.472930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:35.472930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:35.472930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:35.472930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:35.472930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:35.472930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:35.472930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:35.472930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:35.472930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:35.473453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 348/709] 10.222.0.77 () {56 vars in 1093 bytes} [Thu Jun 16 17:17:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:35.478621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f9a7b-ba71-4c27-8288-cd291257d968 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:35.499012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb485e-65f4-4ffc-84ab-000b273655e9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:35.545344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d300a-db89-4588-bc19-91b8087d8f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:35.546578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d300a-db89-4588-bc19-91b8087d8f5e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.546871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d300a-db89-4588-bc19-91b8087d8f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.547147 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d300a-db89-4588-bc19-91b8087d8f5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.563660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d300a-db89-4588-bc19-91b8087d8f5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-8b3d300a-db89-4588-bc19-91b8087d8f5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:35.571605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:35.573188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:35.574171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 362/710] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:35.574923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeff2e-42f5-4639-a712-1c6148989bb4 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.575000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeff2e-42f5-4639-a712-1c6148989bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.575648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeff2e-42f5-4639-a712-1c6148989bb4 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.581391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 363/711] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:35.582147 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aeff2e-42f5-4639-a712-1c6148989bb4 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:35.622390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f9a7b-ba71-4c27-8288-cd291257d968 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:35.660499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:35.661306 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600b096-86c0-4f45-9347-5cd0b34a19a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:35.662183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600b096-86c0-4f45-9347-5cd0b34a19a9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.662695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600b096-86c0-4f45-9347-5cd0b34a19a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.663191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600b096-86c0-4f45-9347-5cd0b34a19a9 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.664265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600b096-86c0-4f45-9347-5cd0b34a19a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:35.664781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600b096-86c0-4f45-9347-5cd0b34a19a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:35.667047 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600b096-86c0-4f45-9347-5cd0b34a19a9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:35.689535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 349/712] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Jun 16 17:17:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:35.695569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aeff2e-42f5-4639-a712-1c6148989bb4 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:35.696798 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01257d7-0f9d-4c59-a72c-cd45760fdf00 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.697271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01257d7-0f9d-4c59-a72c-cd45760fdf00 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.697830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01257d7-0f9d-4c59-a72c-cd45760fdf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.716565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a01257d7-0f9d-4c59-a72c-cd45760fdf00 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:35.718241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a01257d7-0f9d-4c59-a72c-cd45760fdf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:35.742065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f91ce-74cc-4104-b15c-6c48198d3919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:35.742851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f91ce-74cc-4104-b15c-6c48198d3919 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.743209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f91ce-74cc-4104-b15c-6c48198d3919 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.743567 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f91ce-74cc-4104-b15c-6c48198d3919 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.745017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f91ce-74cc-4104-b15c-6c48198d3919 None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:35.745411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f91ce-74cc-4104-b15c-6c48198d3919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:35.747197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f91ce-74cc-4104-b15c-6c48198d3919 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:35.763246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 364/713] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:35.764535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f91ce-74cc-4104-b15c-6c48198d3919 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:35.778060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:35.808861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 350/714] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:35.810040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01257d7-0f9d-4c59-a72c-cd45760fdf00 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:35.935632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f91ce-74cc-4104-b15c-6c48198d3919 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:35.940316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01257d7-0f9d-4c59-a72c-cd45760fdf00 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:35.964848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:35.985039 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ecaed-d567-4236-895d-956cc88b08a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:35.985825 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ecaed-d567-4236-895d-956cc88b08a8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.986200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ecaed-d567-4236-895d-956cc88b08a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.986513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ecaed-d567-4236-895d-956cc88b08a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.987817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27121eb-f42a-4e4d-8099-ec2f61570fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:35.989001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27121eb-f42a-4e4d-8099-ec2f61570fde None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:35.989590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27121eb-f42a-4e4d-8099-ec2f61570fde None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:35.990090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27121eb-f42a-4e4d-8099-ec2f61570fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:35.998757 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ecaed-d567-4236-895d-956cc88b08a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:36.000254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ecaed-d567-4236-895d-956cc88b08a8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5a7ecaed-d567-4236-895d-956cc88b08a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:36.021158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:36.022591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:36.024046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:36.024046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:36.024046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:36.024046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:36.028131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 351/715] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:36.028901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ecaed-d567-4236-895d-956cc88b08a8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:36.063120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:36.081096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27121eb-f42a-4e4d-8099-ec2f61570fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:36.083494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27121eb-f42a-4e4d-8099-ec2f61570fde None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:36.142365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ecaed-d567-4236-895d-956cc88b08a8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:36.180875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972156-9454-4789-86ae-17d9aeb7ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:36.181705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972156-9454-4789-86ae-17d9aeb7ae5d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:36.182166 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972156-9454-4789-86ae-17d9aeb7ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:36.182455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972156-9454-4789-86ae-17d9aeb7ae5d None admin] PATH_INFO: `/v3/services/network` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:36.183127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972156-9454-4789-86ae-17d9aeb7ae5d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:36.184666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972156-9454-4789-86ae-17d9aeb7ae5d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-58972156-9454-4789-86ae-17d9aeb7ae5d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:36.200790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:36.201811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:17:36.202713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:36.208116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 352/717] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:36 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:36.208116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972156-9454-4789-86ae-17d9aeb7ae5d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:36.211213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 365/717] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:36.212381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27121eb-f42a-4e4d-8099-ec2f61570fde None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:36.236937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:36.321369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:36.327984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972156-9454-4789-86ae-17d9aeb7ae5d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:36.333179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27121eb-f42a-4e4d-8099-ec2f61570fde None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:36.367891 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a151245-ee49-4a42-addb-cade6ff25ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:36.368797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a151245-ee49-4a42-addb-cade6ff25ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:36.369305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a151245-ee49-4a42-addb-cade6ff25ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:36.370398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a151245-ee49-4a42-addb-cade6ff25ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:36.371023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01181ded-d507-4615-bff1-9e2ecc8a6979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:36.371435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a151245-ee49-4a42-addb-cade6ff25ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:36.371768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181ded-d507-4615-bff1-9e2ecc8a6979 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:36.371878 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a151245-ee49-4a42-addb-cade6ff25ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:36.372483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181ded-d507-4615-bff1-9e2ecc8a6979 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:36.372614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181ded-d507-4615-bff1-9e2ecc8a6979 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:36.373359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01181ded-d507-4615-bff1-9e2ecc8a6979 None admin] RBAC: Adding query filter params (name=network) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:36.373727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01181ded-d507-4615-bff1-9e2ecc8a6979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:36.374069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a151245-ee49-4a42-addb-cade6ff25ed6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:36.375351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01181ded-d507-4615-bff1-9e2ecc8a6979 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:36.380746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 366/718] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:17:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:36.382218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01181ded-d507-4615-bff1-9e2ecc8a6979 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:36.398800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 353/719] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:36.399933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a151245-ee49-4a42-addb-cade6ff25ed6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:36.496491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:36.511092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01181ded-d507-4615-bff1-9e2ecc8a6979 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:36.514005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a151245-ee49-4a42-addb-cade6ff25ed6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:36.553022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8b7e5-3cf9-4f44-ad20-18522779e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:36.554480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8b7e5-3cf9-4f44-ad20-18522779e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:36.554764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8b7e5-3cf9-4f44-ad20-18522779e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:36.555054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8b7e5-3cf9-4f44-ad20-18522779e5c2 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:36.555732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8b7e5-3cf9-4f44-ad20-18522779e5c2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:36.556040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8b7e5-3cf9-4f44-ad20-18522779e5c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:36.557973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8b7e5-3cf9-4f44-ad20-18522779e5c2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:36.561789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511366c-8b08-4eed-bda1-2c701c178a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:36.562629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511366c-8b08-4eed-bda1-2c701c178a56 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:36.563299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511366c-8b08-4eed-bda1-2c701c178a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:36.563578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511366c-8b08-4eed-bda1-2c701c178a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:36.567311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 354/720] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:17:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:36.568551 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8b7e5-3cf9-4f44-ad20-18522779e5c2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:36.587119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511366c-8b08-4eed-bda1-2c701c178a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:36.589933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511366c-8b08-4eed-bda1-2c701c178a56 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-0511366c-8b08-4eed-bda1-2c701c178a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:36.619092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:36.620624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:36.621490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:36.621490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:36.621490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:36.621490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:36.621721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 367/721] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:36.628995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511366c-8b08-4eed-bda1-2c701c178a56 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:36.653603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:36.773193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8b7e5-3cf9-4f44-ad20-18522779e5c2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:36.774820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511366c-8b08-4eed-bda1-2c701c178a56 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:36.815283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafc347-ba78-4226-9bd9-1d68bc6e7304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:36.816180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafc347-ba78-4226-9bd9-1d68bc6e7304 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:36.816444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafc347-ba78-4226-9bd9-1d68bc6e7304 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:36.816725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafc347-ba78-4226-9bd9-1d68bc6e7304 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:36.824801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022c4ff-dced-4c8c-870f-de0dd6c75e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:36.825502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c4ff-dced-4c8c-870f-de0dd6c75e12 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:36.825788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c4ff-dced-4c8c-870f-de0dd6c75e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:36.826066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c4ff-dced-4c8c-870f-de0dd6c75e12 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:36.826816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022c4ff-dced-4c8c-870f-de0dd6c75e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:36.827127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022c4ff-dced-4c8c-870f-de0dd6c75e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:36.828696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022c4ff-dced-4c8c-870f-de0dd6c75e12 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:36.832626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:36.834401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafc347-ba78-4226-9bd9-1d68bc6e7304 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:36.836190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafc347-ba78-4226-9bd9-1d68bc6e7304 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:36.849416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 368/722] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:36.850632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022c4ff-dced-4c8c-870f-de0dd6c75e12 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-adafc347-ba78-4226-9bd9-1d68bc6e7304 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:36.853837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:36.855140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:36.856496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:36.856496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:36.856496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:36.856496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:36.856496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:36.856496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:36.856496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:36.856496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:36.856496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:17:36.856496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:36.858996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 355/723] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Jun 16 17:17:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:36.866045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafc347-ba78-4226-9bd9-1d68bc6e7304 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:37.001144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:37.008493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022c4ff-dced-4c8c-870f-de0dd6c75e12 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:37.027323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafc347-ba78-4226-9bd9-1d68bc6e7304 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:37.047609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b8d6d-160b-4081-b9ed-dd5c0572e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:37.048447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b8d6d-160b-4081-b9ed-dd5c0572e30d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.048735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b8d6d-160b-4081-b9ed-dd5c0572e30d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.049013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b8d6d-160b-4081-b9ed-dd5c0572e30d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.056446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b8d6d-160b-4081-b9ed-dd5c0572e30d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:37.058772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b8d6d-160b-4081-b9ed-dd5c0572e30d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:37.069887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2a540-a3d5-430b-b214-8f4ed25c2931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:37.070619 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2a540-a3d5-430b-b214-8f4ed25c2931 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.070908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2a540-a3d5-430b-b214-8f4ed25c2931 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.071186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2a540-a3d5-430b-b214-8f4ed25c2931 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.072105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2a540-a3d5-430b-b214-8f4ed25c2931 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:37.072458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2a540-a3d5-430b-b214-8f4ed25c2931 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:37.073886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2a540-a3d5-430b-b214-8f4ed25c2931 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-833b8d6d-160b-4081-b9ed-dd5c0572e30d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:37.074707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:37.075558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:37.076475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:37.076475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:37.076475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:37.076475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:37.076475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:37.076475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:37.076475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:37.076475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:37.076475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 369/724] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:37.080155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda36b1-425b-4dc7-a884-10f851276dd6 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.080155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda36b1-425b-4dc7-a884-10f851276dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.080155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda36b1-425b-4dc7-a884-10f851276dd6 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.080155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 370/725] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:37.085399 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734b8ac-5efe-410a-bc32-d86b0f856d12 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.085689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734b8ac-5efe-410a-bc32-d86b0f856d12 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.085970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734b8ac-5efe-410a-bc32-d86b0f856d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.100462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 356/726] 10.222.0.77 () {56 vars in 1149 bytes} [Thu Jun 16 17:17:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:37.101388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2a540-a3d5-430b-b214-8f4ed25c2931 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:37.109990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-7734b8ac-5efe-410a-bc32-d86b0f856d12 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:37.111316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7734b8ac-5efe-410a-bc32-d86b0f856d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:37.180913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:37.203483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 371/727] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:17:37.204462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734b8ac-5efe-410a-bc32-d86b0f856d12 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:37.243857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2a540-a3d5-430b-b214-8f4ed25c2931 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:37.285951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd085a-48d4-4e07-9ba2-4d82c709ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:37.287018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd085a-48d4-4e07-9ba2-4d82c709ab57 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.287303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd085a-48d4-4e07-9ba2-4d82c709ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.287579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd085a-48d4-4e07-9ba2-4d82c709ab57 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.289515 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd085a-48d4-4e07-9ba2-4d82c709ab57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:37.289844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd085a-48d4-4e07-9ba2-4d82c709ab57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:37.291572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd085a-48d4-4e07-9ba2-4d82c709ab57 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:37.308306 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 357/728] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:37.309145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd085a-48d4-4e07-9ba2-4d82c709ab57 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:37.312393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:37.327767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734b8ac-5efe-410a-bc32-d86b0f856d12 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:37.365591 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e6f0a-432e-43a0-8ac5-c6d709d053c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:37.366274 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e6f0a-432e-43a0-8ac5-c6d709d053c9 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.366416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e6f0a-432e-43a0-8ac5-c6d709d053c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.366682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e6f0a-432e-43a0-8ac5-c6d709d053c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.434315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:37.447562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e6f0a-432e-43a0-8ac5-c6d709d053c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:37.449189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e6f0a-432e-43a0-8ac5-c6d709d053c9 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:37.462246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd085a-48d4-4e07-9ba2-4d82c709ab57 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:37.510709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64443e36-a0cc-42d8-8da6-c6ca84985804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:37.512316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64443e36-a0cc-42d8-8da6-c6ca84985804 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.512632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64443e36-a0cc-42d8-8da6-c6ca84985804 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.512908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64443e36-a0cc-42d8-8da6-c6ca84985804 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.513892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64443e36-a0cc-42d8-8da6-c6ca84985804 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:37.515292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64443e36-a0cc-42d8-8da6-c6ca84985804 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:37.563599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 372/729] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 17:17:37.564913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e6f0a-432e-43a0-8ac5-c6d709d053c9 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:37.629932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 358/730] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:17:37 2022] POST /identity/v3/services => generated 251 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:37.631067 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64443e36-a0cc-42d8-8da6-c6ca84985804 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:37.665763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:37.682613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e6f0a-432e-43a0-8ac5-c6d709d053c9 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:37.719036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:37.745186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c91fe-c040-4cbe-839a-f88d1f62a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:37.746347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c91fe-c040-4cbe-839a-f88d1f62a09e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.746788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c91fe-c040-4cbe-839a-f88d1f62a09e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.747245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c91fe-c040-4cbe-839a-f88d1f62a09e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.748278 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c91fe-c040-4cbe-839a-f88d1f62a09e None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=ba0bb071b7c04e1da55259f079a9c805) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:37.749007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c91fe-c040-4cbe-839a-f88d1f62a09e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:37.750651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c91fe-c040-4cbe-839a-f88d1f62a09e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:37.767915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 373/731] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:37 2022] GET /identity/v3/role_assignments?user.id=ba0bb071b7c04e1da55259f079a9c805&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:37.775390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64443e36-a0cc-42d8-8da6-c6ca84985804 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:37.798852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b6eb3-091d-4b66-a79b-f4c30946da1a None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.799138 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b6eb3-091d-4b66-a79b-f4c30946da1a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.799419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b6eb3-091d-4b66-a79b-f4c30946da1a None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.801132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 374/732] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:17:37.807450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0322d0-621a-452e-b309-dc235e52b71b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.807820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0322d0-621a-452e-b309-dc235e52b71b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.808102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0322d0-621a-452e-b309-dc235e52b71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.820256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd3cf-6a26-40da-b82b-1df26129f893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:37.821181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd3cf-6a26-40da-b82b-1df26129f893 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:37.821530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd3cf-6a26-40da-b82b-1df26129f893 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:37.821870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd3cf-6a26-40da-b82b-1df26129f893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:37.827786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-1a0322d0-621a-452e-b309-dc235e52b71b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:37.829126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-1a0322d0-621a-452e-b309-dc235e52b71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:37.838830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdd3cf-6a26-40da-b82b-1df26129f893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:37.840585 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdd3cf-6a26-40da-b82b-1df26129f893 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-28fdd3cf-6a26-40da-b82b-1df26129f893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:37.867592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:37.868656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:37.869769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:37.869769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:37.869769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:37.869769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:37.869769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 359/733] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:37.875924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd3cf-6a26-40da-b82b-1df26129f893 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:37.966651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 375/734] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 17:17:38.001778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0322d0-621a-452e-b309-dc235e52b71b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:38.009915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd3cf-6a26-40da-b82b-1df26129f893 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:38.029326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:38.067823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b5fd9-7d5b-40c9-9150-bcb5c65455b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:38.068685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b5fd9-7d5b-40c9-9150-bcb5c65455b5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:38.069043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b5fd9-7d5b-40c9-9150-bcb5c65455b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:38.069367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b5fd9-7d5b-40c9-9150-bcb5c65455b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:38.070223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b5fd9-7d5b-40c9-9150-bcb5c65455b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:38.070594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b5fd9-7d5b-40c9-9150-bcb5c65455b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:38.072065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b5fd9-7d5b-40c9-9150-bcb5c65455b5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:38.092455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 360/735] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:38.093371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b5fd9-7d5b-40c9-9150-bcb5c65455b5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:38.108467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:38.133605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0322d0-621a-452e-b309-dc235e52b71b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:38.173959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37a241-7f77-41a4-9683-08f1e8a3db96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:38.174816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a241-7f77-41a4-9683-08f1e8a3db96 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:38.175101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a241-7f77-41a4-9683-08f1e8a3db96 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:38.175375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a241-7f77-41a4-9683-08f1e8a3db96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:38.189429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37a241-7f77-41a4-9683-08f1e8a3db96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-2d37a241-7f77-41a4-9683-08f1e8a3db96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:38.198532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:38.199489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:38.200461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:38.203810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 376/736] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:38.207081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37a241-7f77-41a4-9683-08f1e8a3db96 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:38.313092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b5fd9-7d5b-40c9-9150-bcb5c65455b5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:38.377487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37a241-7f77-41a4-9683-08f1e8a3db96 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:38.380107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9a57-a3a7-4c18-adb2-83b2b502feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:38.380921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9a57-a3a7-4c18-adb2-83b2b502feb3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:38.381203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9a57-a3a7-4c18-adb2-83b2b502feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:38.381479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9a57-a3a7-4c18-adb2-83b2b502feb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:38.397101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9a57-a3a7-4c18-adb2-83b2b502feb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:38.398559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9a57-a3a7-4c18-adb2-83b2b502feb3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-afea9a57-a3a7-4c18-adb2-83b2b502feb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:38.417966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:38.418916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:38.419793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:38.419793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:38.419793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:38.419793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:38.419793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:38.419793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:38.419793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:38.419793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:38.419793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 361/737] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:38.426596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9a57-a3a7-4c18-adb2-83b2b502feb3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:38.459961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7a878-af05-429d-a664-2a136d5a4cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:38.460882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7a878-af05-429d-a664-2a136d5a4cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:38.461408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7a878-af05-429d-a664-2a136d5a4cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:38.462416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7a878-af05-429d-a664-2a136d5a4cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:38.463809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7a878-af05-429d-a664-2a136d5a4cc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:38.465263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7a878-af05-429d-a664-2a136d5a4cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:38.468010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7a878-af05-429d-a664-2a136d5a4cc6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:38.473489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:38.474267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:38.491141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 377/738] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:38.500729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7a878-af05-429d-a664-2a136d5a4cc6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:38.625001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9a57-a3a7-4c18-adb2-83b2b502feb3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:38.693294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2112b4d-9836-4303-a0ce-f959480e4055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:38.694173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2112b4d-9836-4303-a0ce-f959480e4055 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:38.694459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2112b4d-9836-4303-a0ce-f959480e4055 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:38.694741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2112b4d-9836-4303-a0ce-f959480e4055 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:38.695522 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2112b4d-9836-4303-a0ce-f959480e4055 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:38.695832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2112b4d-9836-4303-a0ce-f959480e4055 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:38.697743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2112b4d-9836-4303-a0ce-f959480e4055 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:38.700117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7a878-af05-429d-a664-2a136d5a4cc6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:38.711637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 362/739] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:38.721094 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2112b4d-9836-4303-a0ce-f959480e4055 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:38.745714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e2ab9-0425-4b37-9d1f-22e0e9629ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:38.746526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e2ab9-0425-4b37-9d1f-22e0e9629ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:38.746809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e2ab9-0425-4b37-9d1f-22e0e9629ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:38.747086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e2ab9-0425-4b37-9d1f-22e0e9629ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:38.758077 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e2ab9-0425-4b37-9d1f-22e0e9629ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:38.759620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e2ab9-0425-4b37-9d1f-22e0e9629ef6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-0b2e2ab9-0425-4b37-9d1f-22e0e9629ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:38.780370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:38.781499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:38.782376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:38.782376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:38.782376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:38.782376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:38.784662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 378/740] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:38.793160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e2ab9-0425-4b37-9d1f-22e0e9629ef6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:38.862438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:38.873256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2112b4d-9836-4303-a0ce-f959480e4055 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:38.910636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301d7b6-c351-41b8-b9da-1daa42d99f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:38.911321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301d7b6-c351-41b8-b9da-1daa42d99f9c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:38.911605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301d7b6-c351-41b8-b9da-1daa42d99f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:38.911882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301d7b6-c351-41b8-b9da-1daa42d99f9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:38.912787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301d7b6-c351-41b8-b9da-1daa42d99f9c None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=9f9b0c02f87340998d1736f2062b7164) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:38.913101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301d7b6-c351-41b8-b9da-1daa42d99f9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:38.915841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301d7b6-c351-41b8-b9da-1daa42d99f9c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:38.922885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 363/741] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:38 2022] GET /identity/v3/role_assignments?user.id=9f9b0c02f87340998d1736f2062b7164&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:38.926121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:39.015676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e2ab9-0425-4b37-9d1f-22e0e9629ef6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:39.084983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45645a-ec86-42ae-b1e1-bba61cc23a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:39.086342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45645a-ec86-42ae-b1e1-bba61cc23a05 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:39.086342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45645a-ec86-42ae-b1e1-bba61cc23a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:39.086342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45645a-ec86-42ae-b1e1-bba61cc23a05 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:39.086971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45645a-ec86-42ae-b1e1-bba61cc23a05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:39.087284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45645a-ec86-42ae-b1e1-bba61cc23a05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:39.088840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45645a-ec86-42ae-b1e1-bba61cc23a05 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:39.102704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 379/742] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:39.108889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301d7b6-c351-41b8-b9da-1daa42d99f9c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:39.112608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc1568-ff62-467a-9fb2-3306422a264a None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:39.112836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc1568-ff62-467a-9fb2-3306422a264a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:39.113124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc1568-ff62-467a-9fb2-3306422a264a None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:39.114603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 380/743] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:17:39.120506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63246d-ff0c-416e-b03a-39d126d51478 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:39.120797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63246d-ff0c-416e-b03a-39d126d51478 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:39.121082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63246d-ff0c-416e-b03a-39d126d51478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:39.141909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-0d63246d-ff0c-416e-b03a-39d126d51478 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:39.143128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0d63246d-ff0c-416e-b03a-39d126d51478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:39.241344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 381/744] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 17:17:39.265996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63246d-ff0c-416e-b03a-39d126d51478 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:39.282791 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301d7b6-c351-41b8-b9da-1daa42d99f9c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:39.317234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:39.382687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63246d-ff0c-416e-b03a-39d126d51478 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:39.393392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad8c8a-bc81-4121-ad82-38720831203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:39.394226 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad8c8a-bc81-4121-ad82-38720831203a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:39.394505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad8c8a-bc81-4121-ad82-38720831203a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:39.394781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad8c8a-bc81-4121-ad82-38720831203a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:39.412915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad8c8a-bc81-4121-ad82-38720831203a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:39.414367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad8c8a-bc81-4121-ad82-38720831203a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:39.420143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11a77-a52e-4e07-b48a-7554a83e269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:39.420830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11a77-a52e-4e07-b48a-7554a83e269d None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:39.421117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11a77-a52e-4e07-b48a-7554a83e269d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:39.421391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11a77-a52e-4e07-b48a-7554a83e269d None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:39.422108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11a77-a52e-4e07-b48a-7554a83e269d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:39.423634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11a77-a52e-4e07-b48a-7554a83e269d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b9ad8c8a-bc81-4121-ad82-38720831203a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:39.441620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:39.445960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:39.446885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 364/745] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:39.448767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad8c8a-bc81-4121-ad82-38720831203a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:39.465720 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:39.528917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 382/746] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:17:39 2022] POST /identity/v3/services => generated 240 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:17:39.577891 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad8c8a-bc81-4121-ad82-38720831203a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:39.633314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32bb13-df08-4ca3-9bc7-23fc462515b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:39.633942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32bb13-df08-4ca3-9bc7-23fc462515b0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:39.634220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32bb13-df08-4ca3-9bc7-23fc462515b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:39.634494 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32bb13-df08-4ca3-9bc7-23fc462515b0 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:39.635637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32bb13-df08-4ca3-9bc7-23fc462515b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:39.635945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32bb13-df08-4ca3-9bc7-23fc462515b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:39.637445 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32bb13-df08-4ca3-9bc7-23fc462515b0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:39.659582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 365/747] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Jun 16 17:17:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:39.665434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11a77-a52e-4e07-b48a-7554a83e269d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:39.806527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:39.811547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11a77-a52e-4e07-b48a-7554a83e269d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:39.851587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5258ef8-145a-4544-b88b-9c41645a8752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:39.852312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258ef8-145a-4544-b88b-9c41645a8752 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:39.852598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258ef8-145a-4544-b88b-9c41645a8752 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:39.852879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258ef8-145a-4544-b88b-9c41645a8752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:39.925979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5258ef8-145a-4544-b88b-9c41645a8752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:39.927386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5258ef8-145a-4544-b88b-9c41645a8752 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:40.029520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:40.033506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 383/748] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:17:40.039313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32bb13-df08-4ca3-9bc7-23fc462515b0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:40.133352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:40.179295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32bb13-df08-4ca3-9bc7-23fc462515b0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:40.230891 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e70681-ccd8-4a6f-901a-c2c1970f764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:40.231721 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e70681-ccd8-4a6f-901a-c2c1970f764c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.232002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e70681-ccd8-4a6f-901a-c2c1970f764c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.232320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e70681-ccd8-4a6f-901a-c2c1970f764c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.243331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e70681-ccd8-4a6f-901a-c2c1970f764c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:40.245518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e70681-ccd8-4a6f-901a-c2c1970f764c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-27e70681-ccd8-4a6f-901a-c2c1970f764c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:40.264134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:40.265099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:40.265972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:40.265972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:40.265972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:40.265972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:40.265972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 366/749] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:40.274143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5258ef8-145a-4544-b88b-9c41645a8752 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:40.415538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5258ef8-145a-4544-b88b-9c41645a8752 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:40.465666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a36d8-2e9c-4da4-86cf-21bbff4e21d8 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.466159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a36d8-2e9c-4da4-86cf-21bbff4e21d8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.466159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a36d8-2e9c-4da4-86cf-21bbff4e21d8 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.468839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 367/750] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:17:40.473135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dfb3c-9eb0-4274-bce5-33bfa30300a8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.473423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dfb3c-9eb0-4274-bce5-33bfa30300a8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.473729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dfb3c-9eb0-4274-bce5-33bfa30300a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.476504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c01a7c-1f8d-4ce6-a598-cfb493bb0466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:40.477429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c01a7c-1f8d-4ce6-a598-cfb493bb0466 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.477934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c01a7c-1f8d-4ce6-a598-cfb493bb0466 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.478355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c01a7c-1f8d-4ce6-a598-cfb493bb0466 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.479489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c01a7c-1f8d-4ce6-a598-cfb493bb0466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:40.480003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c01a7c-1f8d-4ce6-a598-cfb493bb0466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:40.482892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c01a7c-1f8d-4ce6-a598-cfb493bb0466 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:40.499530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-366dfb3c-9eb0-4274-bce5-33bfa30300a8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:40.504190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-366dfb3c-9eb0-4274-bce5-33bfa30300a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:40.508876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 384/751] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:40.516040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c01a7c-1f8d-4ce6-a598-cfb493bb0466 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:40.609942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:40.627685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 368/752] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:17:40.629505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1b92a-76b1-4da6-a51c-967895fc3636 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.629976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1b92a-76b1-4da6-a51c-967895fc3636 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.630457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1b92a-76b1-4da6-a51c-967895fc3636 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.632930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 369/753] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:40.638859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6e249-b5c5-46b6-aacc-f9b450773a73 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.639154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6e249-b5c5-46b6-aacc-f9b450773a73 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.639445 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6e249-b5c5-46b6-aacc-f9b450773a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.656528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-def6e249-b5c5-46b6-aacc-f9b450773a73 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:40.657716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-def6e249-b5c5-46b6-aacc-f9b450773a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:40.668775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c01a7c-1f8d-4ce6-a598-cfb493bb0466 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:40.711491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b1e81-a69a-4707-9126-2ae53053c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:40.712377 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b1e81-a69a-4707-9126-2ae53053c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.712658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b1e81-a69a-4707-9126-2ae53053c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.713054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b1e81-a69a-4707-9126-2ae53053c0c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.713872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:40.720750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b1e81-a69a-4707-9126-2ae53053c0c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:40.722350 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b1e81-a69a-4707-9126-2ae53053c0c1 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:40.737843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 370/754] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:17:40.738993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6e249-b5c5-46b6-aacc-f9b450773a73 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-5f1b1e81-a69a-4707-9126-2ae53053c0c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:40.745543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:40.746477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:40.747363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:40.747363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:40.747363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:40.747363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:40.747363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:40.747363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:40.747363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:40.747363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:40.747363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 385/755] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:40.752765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b1e81-a69a-4707-9126-2ae53053c0c1 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:40.875761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6e249-b5c5-46b6-aacc-f9b450773a73 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:40.876686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b1e81-a69a-4707-9126-2ae53053c0c1 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:40.903752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:40.914325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628572ec-7d29-49ef-bc7d-0b4fc1c604e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:40.915575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628572ec-7d29-49ef-bc7d-0b4fc1c604e9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.916125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628572ec-7d29-49ef-bc7d-0b4fc1c604e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.916608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628572ec-7d29-49ef-bc7d-0b4fc1c604e9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.918030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628572ec-7d29-49ef-bc7d-0b4fc1c604e9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:40.919743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628572ec-7d29-49ef-bc7d-0b4fc1c604e9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:40.920796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ae5b0-668c-4180-b944-7bce932ebde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:40.921563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ae5b0-668c-4180-b944-7bce932ebde5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:40.922211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ae5b0-668c-4180-b944-7bce932ebde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:40.922591 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ae5b0-668c-4180-b944-7bce932ebde5 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:40.924338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ae5b0-668c-4180-b944-7bce932ebde5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:40.924989 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ae5b0-668c-4180-b944-7bce932ebde5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:40.926484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ae5b0-668c-4180-b944-7bce932ebde5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-628572ec-7d29-49ef-bc7d-0b4fc1c604e9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:40.934693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:40.935612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:17:40.936813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:40.939376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 371/756] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Jun 16 17:17:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:40.939597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 386/757] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:40.940520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628572ec-7d29-49ef-bc7d-0b4fc1c604e9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:40.946265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ae5b0-668c-4180-b944-7bce932ebde5 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:40.990995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:41.052592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628572ec-7d29-49ef-bc7d-0b4fc1c604e9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:41.056399 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ae5b0-668c-4180-b944-7bce932ebde5 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:41.090831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6218-640e-4114-aafc-ae1d9c32d257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:41.092173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6218-640e-4114-aafc-ae1d9c32d257 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.092601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6218-640e-4114-aafc-ae1d9c32d257 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.093021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6218-640e-4114-aafc-ae1d9c32d257 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.094167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbad781-ab9f-4b89-91ff-80de194825f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:41.094923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbad781-ab9f-4b89-91ff-80de194825f1 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.095330 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbad781-ab9f-4b89-91ff-80de194825f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.095682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbad781-ab9f-4b89-91ff-80de194825f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.096638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbad781-ab9f-4b89-91ff-80de194825f1 None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=e3c319430309419c895a0dc3c90ce80e) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:41.097054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbad781-ab9f-4b89-91ff-80de194825f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:41.098598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbad781-ab9f-4b89-91ff-80de194825f1 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:41.105141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 387/758] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:40 2022] GET /identity/v3/role_assignments?user.id=e3c319430309419c895a0dc3c90ce80e&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:41.105456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd6218-640e-4114-aafc-ae1d9c32d257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:41.106167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbad781-ab9f-4b89-91ff-80de194825f1 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-e1cd6218-640e-4114-aafc-ae1d9c32d257 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:41.113654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:41.114668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:41.115502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:41.117926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 372/759] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:41.126530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6218-640e-4114-aafc-ae1d9c32d257 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:41.197130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:41.303464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbad781-ab9f-4b89-91ff-80de194825f1 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:41.342138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6218-640e-4114-aafc-ae1d9c32d257 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:41.359844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c278b-43bb-4365-9796-758b8483407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:41.360659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c278b-43bb-4365-9796-758b8483407d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.360945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c278b-43bb-4365-9796-758b8483407d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.361220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c278b-43bb-4365-9796-758b8483407d None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.361925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c278b-43bb-4365-9796-758b8483407d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:41.362230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c278b-43bb-4365-9796-758b8483407d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:41.363593 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c278b-43bb-4365-9796-758b8483407d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:41.367205 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:41.372406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 388/760] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Jun 16 17:17:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:41.377710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c278b-43bb-4365-9796-758b8483407d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:41.445357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa606f8-cb68-49e5-986f-340615dab70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:41.446063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa606f8-cb68-49e5-986f-340615dab70e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.446405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa606f8-cb68-49e5-986f-340615dab70e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.446693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa606f8-cb68-49e5-986f-340615dab70e None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.448681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa606f8-cb68-49e5-986f-340615dab70e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:41.448929 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa606f8-cb68-49e5-986f-340615dab70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:41.450314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa606f8-cb68-49e5-986f-340615dab70e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:41.474335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 373/761] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:41.480581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa606f8-cb68-49e5-986f-340615dab70e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:41.493782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c278b-43bb-4365-9796-758b8483407d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:41.511607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:41.535574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9e959-afd1-4c2e-9bd5-4f95a569b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:41.536310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e959-afd1-4c2e-9bd5-4f95a569b3aa None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.536594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e959-afd1-4c2e-9bd5-4f95a569b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.536871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e959-afd1-4c2e-9bd5-4f95a569b3aa None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.537682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9e959-afd1-4c2e-9bd5-4f95a569b3aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:41.537989 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9e959-afd1-4c2e-9bd5-4f95a569b3aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:41.539483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9e959-afd1-4c2e-9bd5-4f95a569b3aa None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:41.545982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 389/762] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Jun 16 17:17:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:41.551871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9e959-afd1-4c2e-9bd5-4f95a569b3aa None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:41.653738 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa606f8-cb68-49e5-986f-340615dab70e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:41.671407 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9e959-afd1-4c2e-9bd5-4f95a569b3aa None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:41.692547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc4657-878c-412a-b28a-40b66633c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:41.693634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4657-878c-412a-b28a-40b66633c847 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.693922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4657-878c-412a-b28a-40b66633c847 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.694202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4657-878c-412a-b28a-40b66633c847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.709129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc4657-878c-412a-b28a-40b66633c847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:41.711288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc4657-878c-412a-b28a-40b66633c847 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:41.718526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e75bb4-b066-4774-a57c-c800b4eb75aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:41.719200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75bb4-b066-4774-a57c-c800b4eb75aa None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.719485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75bb4-b066-4774-a57c-c800b4eb75aa None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.719762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75bb4-b066-4774-a57c-c800b4eb75aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.720646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e75bb4-b066-4774-a57c-c800b4eb75aa None admin] RBAC: Adding query filter params (interface=public, service_id=2dc55b5cca1748999913da9e608e75fe, region_id=RegionOne) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:41.720960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e75bb4-b066-4774-a57c-c800b4eb75aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:41.722421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e75bb4-b066-4774-a57c-c800b4eb75aa None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:41.731620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 390/763] 10.222.0.77 () {56 vars in 1251 bytes} [Thu Jun 16 17:17:41 2022] GET /identity/v3/endpoints?service_id=2dc55b5cca1748999913da9e608e75fe&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ffdc4657-878c-412a-b28a-40b66633c847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:41.732133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:41.732963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:41.733834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:41.733834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:41.733834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:41.733834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:41.734050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e028a-494d-41d9-8fdc-198038d199b5 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.734050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e028a-494d-41d9-8fdc-198038d199b5 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.734050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e028a-494d-41d9-8fdc-198038d199b5 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.738017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 374/764] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:41.738808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc4657-878c-412a-b28a-40b66633c847 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:41.739315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 391/765] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:41.740337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e028a-494d-41d9-8fdc-198038d199b5 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:41.764501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:41.784767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:41.858100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e028a-494d-41d9-8fdc-198038d199b5 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:41.881661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc4657-878c-412a-b28a-40b66633c847 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:41.897910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08b56c-962b-4952-86f1-4fc93aeef729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:41.898662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08b56c-962b-4952-86f1-4fc93aeef729 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.898950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08b56c-962b-4952-86f1-4fc93aeef729 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.899230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08b56c-962b-4952-86f1-4fc93aeef729 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.899948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08b56c-962b-4952-86f1-4fc93aeef729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:41.900853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08b56c-962b-4952-86f1-4fc93aeef729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:41.902890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08b56c-962b-4952-86f1-4fc93aeef729 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:41.922085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 392/766] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:41.922085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1047f-ee87-4f50-80d8-87fe0be91878 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.922085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1047f-ee87-4f50-80d8-87fe0be91878 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.922085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1047f-ee87-4f50-80d8-87fe0be91878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.933902 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e06fd-8370-4b56-adb0-0da28ab82fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:41.934908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e06fd-8370-4b56-adb0-0da28ab82fac None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:41.935644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e06fd-8370-4b56-adb0-0da28ab82fac None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:41.936167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e06fd-8370-4b56-adb0-0da28ab82fac None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:41.937023 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e06fd-8370-4b56-adb0-0da28ab82fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:41.938739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e06fd-8370-4b56-adb0-0da28ab82fac None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:41.939504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-26b1047f-ee87-4f50-80d8-87fe0be91878 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:41.941030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-26b1047f-ee87-4f50-80d8-87fe0be91878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:41.950926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 375/767] 10.222.0.77 () {56 vars in 1087 bytes} [Thu Jun 16 17:17:41 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:41.952591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e06fd-8370-4b56-adb0-0da28ab82fac None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:42.062089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:42.084509 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e06fd-8370-4b56-adb0-0da28ab82fac None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:42.116927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 393/768] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:42.144994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae846bf5-ecf8-4602-a159-2cd15309affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:42.145856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae846bf5-ecf8-4602-a159-2cd15309affd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:42.146209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae846bf5-ecf8-4602-a159-2cd15309affd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:42.146496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae846bf5-ecf8-4602-a159-2cd15309affd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:42.158642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae846bf5-ecf8-4602-a159-2cd15309affd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:42.159473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1047f-ee87-4f50-80d8-87fe0be91878 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:42.160179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae846bf5-ecf8-4602-a159-2cd15309affd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ae846bf5-ecf8-4602-a159-2cd15309affd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:42.176009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:42.177036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:42.178034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 376/769] 10.222.0.77 () {56 vars in 1093 bytes} [Thu Jun 16 17:17:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:42.183830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae846bf5-ecf8-4602-a159-2cd15309affd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:42.198465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:42.282821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1047f-ee87-4f50-80d8-87fe0be91878 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:42.308824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae846bf5-ecf8-4602-a159-2cd15309affd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:42.318013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57fee6-4e88-45de-9c82-4ac54b45c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:42.319105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57fee6-4e88-45de-9c82-4ac54b45c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:42.319587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57fee6-4e88-45de-9c82-4ac54b45c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:42.320056 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57fee6-4e88-45de-9c82-4ac54b45c7d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:42.331598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57fee6-4e88-45de-9c82-4ac54b45c7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-5f57fee6-4e88-45de-9c82-4ac54b45c7d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:42.339727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:42.340683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:42.341504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:42.344182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 394/770] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:42.345626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609783cd-7a8f-4c04-b80a-702afc79bd20 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:42.346126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609783cd-7a8f-4c04-b80a-702afc79bd20 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:42.346540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f93de-9170-4534-97e9-3c2c94b1d72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:42.346837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609783cd-7a8f-4c04-b80a-702afc79bd20 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:42.347219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f93de-9170-4534-97e9-3c2c94b1d72c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:42.347546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f93de-9170-4534-97e9-3c2c94b1d72c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:42.347827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f93de-9170-4534-97e9-3c2c94b1d72c None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:42.348766 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f93de-9170-4534-97e9-3c2c94b1d72c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:42.349158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f93de-9170-4534-97e9-3c2c94b1d72c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:42.349515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 395/771] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:42.350387 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609783cd-7a8f-4c04-b80a-702afc79bd20 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:42.352797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f93de-9170-4534-97e9-3c2c94b1d72c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:42.373319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:42.378812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 377/772] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Jun 16 17:17:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:42.380700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492c0e1-64cf-4911-91fa-e64ef1de052d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:42.381060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492c0e1-64cf-4911-91fa-e64ef1de052d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:42.381407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492c0e1-64cf-4911-91fa-e64ef1de052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:42.404904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1492c0e1-64cf-4911-91fa-e64ef1de052d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:42.406930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1492c0e1-64cf-4911-91fa-e64ef1de052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:42.464120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:42.483020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609783cd-7a8f-4c04-b80a-702afc79bd20 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:42.489264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 378/773] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:42.490170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492c0e1-64cf-4911-91fa-e64ef1de052d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:42.530335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a36f89-49d2-485f-a034-70e972df669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:42.536116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a36f89-49d2-485f-a034-70e972df669a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:42.536116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a36f89-49d2-485f-a034-70e972df669a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:42.536116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a36f89-49d2-485f-a034-70e972df669a None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:42.536116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a36f89-49d2-485f-a034-70e972df669a None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:42.536116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a36f89-49d2-485f-a034-70e972df669a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:42.536116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a36f89-49d2-485f-a034-70e972df669a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:42.552289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 396/774] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:42.553226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a36f89-49d2-485f-a034-70e972df669a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:42.625318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492c0e1-64cf-4911-91fa-e64ef1de052d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:42.662504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:42.669159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb99afd-760a-453b-997b-8cb0cb5c1ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:42.670351 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99afd-760a-453b-997b-8cb0cb5c1ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:42.670351 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99afd-760a-453b-997b-8cb0cb5c1ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:42.670545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99afd-760a-453b-997b-8cb0cb5c1ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:42.680814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb99afd-760a-453b-997b-8cb0cb5c1ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:42.686556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb99afd-760a-453b-997b-8cb0cb5c1ec8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:42.686667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a36f89-49d2-485f-a034-70e972df669a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6bb99afd-760a-453b-997b-8cb0cb5c1ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:42.704491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:42.705436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:42.706310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:42.706310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:42.706310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:42.706310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:42.707063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 379/775] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:42.708098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb99afd-760a-453b-997b-8cb0cb5c1ec8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:42.730257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900d8b6-e2d7-40ad-93bf-15c7dafc12d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:42.731402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900d8b6-e2d7-40ad-93bf-15c7dafc12d3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:42.732162 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900d8b6-e2d7-40ad-93bf-15c7dafc12d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:42.732624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900d8b6-e2d7-40ad-93bf-15c7dafc12d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:42.733618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900d8b6-e2d7-40ad-93bf-15c7dafc12d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:42.735522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900d8b6-e2d7-40ad-93bf-15c7dafc12d3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b900d8b6-e2d7-40ad-93bf-15c7dafc12d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:42.752194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:42.753205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:17:42.754022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:42.757398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 397/776] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:42 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:42.758718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900d8b6-e2d7-40ad-93bf-15c7dafc12d3 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:42.780109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:42.826432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb99afd-760a-453b-997b-8cb0cb5c1ec8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:42.864466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa843d-4320-4fee-9889-9796661a1530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:42.865754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa843d-4320-4fee-9889-9796661a1530 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:42.866233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa843d-4320-4fee-9889-9796661a1530 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:42.866729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa843d-4320-4fee-9889-9796661a1530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:42.879240 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa843d-4320-4fee-9889-9796661a1530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:42.881217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa843d-4320-4fee-9889-9796661a1530 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:42.896110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900d8b6-e2d7-40ad-93bf-15c7dafc12d3 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-84fa843d-4320-4fee-9889-9796661a1530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:42.901793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:42.908822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:42.909736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:42.909736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:42.909736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:42.909736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:42.910383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 380/777] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:42.911642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa843d-4320-4fee-9889-9796661a1530 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:42.941456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35807cfa-505b-4789-9a1e-a418b632d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:42.942125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35807cfa-505b-4789-9a1e-a418b632d71f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:42.942564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35807cfa-505b-4789-9a1e-a418b632d71f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:42.942942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35807cfa-505b-4789-9a1e-a418b632d71f None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:42.943657 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35807cfa-505b-4789-9a1e-a418b632d71f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:42.943967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35807cfa-505b-4789-9a1e-a418b632d71f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:42.946072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35807cfa-505b-4789-9a1e-a418b632d71f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:42.952310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:42.967174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 398/778] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:42.967174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35807cfa-505b-4789-9a1e-a418b632d71f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:43.036307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa843d-4320-4fee-9889-9796661a1530 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:43.049530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:43.075281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baa8eb-d7e1-4085-b22a-6a3cc0ed84fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:43.076406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baa8eb-d7e1-4085-b22a-6a3cc0ed84fb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.076890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baa8eb-d7e1-4085-b22a-6a3cc0ed84fb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.077392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baa8eb-d7e1-4085-b22a-6a3cc0ed84fb None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.078283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baa8eb-d7e1-4085-b22a-6a3cc0ed84fb None admin] RBAC: Adding query filter params (name=network) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:43.078806 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baa8eb-d7e1-4085-b22a-6a3cc0ed84fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:43.080457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baa8eb-d7e1-4085-b22a-6a3cc0ed84fb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:43.085908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 381/779] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:17:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:43.087004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baa8eb-d7e1-4085-b22a-6a3cc0ed84fb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:43.090401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35807cfa-505b-4789-9a1e-a418b632d71f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:43.129336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21336467-f152-4cb9-a54b-300b6e7953f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:43.130328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21336467-f152-4cb9-a54b-300b6e7953f5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.130810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21336467-f152-4cb9-a54b-300b6e7953f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.131283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21336467-f152-4cb9-a54b-300b6e7953f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.132232 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21336467-f152-4cb9-a54b-300b6e7953f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:43.132808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21336467-f152-4cb9-a54b-300b6e7953f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:43.134382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21336467-f152-4cb9-a54b-300b6e7953f5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:43.157842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 399/780] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:43.157842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21336467-f152-4cb9-a54b-300b6e7953f5 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:43.208324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:43.213602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baa8eb-d7e1-4085-b22a-6a3cc0ed84fb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:43.257242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65927c7-0459-4327-b513-5249d8eeffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:43.258385 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65927c7-0459-4327-b513-5249d8eeffa2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.258676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65927c7-0459-4327-b513-5249d8eeffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.258960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65927c7-0459-4327-b513-5249d8eeffa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.268306 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65927c7-0459-4327-b513-5249d8eeffa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:43.270363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65927c7-0459-4327-b513-5249d8eeffa2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:43.290479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21336467-f152-4cb9-a54b-300b6e7953f5 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-c65927c7-0459-4327-b513-5249d8eeffa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:43.290659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:43.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:43.293050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:43.293050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:43.293050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:43.293050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:43.293050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:43.293050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:43.293050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:43.293050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:43.293050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 382/781] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:43.293537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65927c7-0459-4327-b513-5249d8eeffa2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:43.319301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328fc72-f495-49d8-aace-e808107777e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:43.320032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328fc72-f495-49d8-aace-e808107777e9 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.320372 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328fc72-f495-49d8-aace-e808107777e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.320681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328fc72-f495-49d8-aace-e808107777e9 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.321451 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328fc72-f495-49d8-aace-e808107777e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:43.321764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328fc72-f495-49d8-aace-e808107777e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:43.324512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328fc72-f495-49d8-aace-e808107777e9 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:43.330688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 400/782] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:17:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:43.331612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328fc72-f495-49d8-aace-e808107777e9 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:43.344481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:43.418395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65927c7-0459-4327-b513-5249d8eeffa2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:43.459414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef252d3-8848-47e5-9577-327c01b9c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:43.459969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328fc72-f495-49d8-aace-e808107777e9 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:43.460348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef252d3-8848-47e5-9577-327c01b9c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.460638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef252d3-8848-47e5-9577-327c01b9c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.461004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef252d3-8848-47e5-9577-327c01b9c0c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.471608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef252d3-8848-47e5-9577-327c01b9c0c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:43.473149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef252d3-8848-47e5-9577-327c01b9c0c1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-3ef252d3-8848-47e5-9577-327c01b9c0c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:43.490248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:43.491681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:43.492639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:43.492639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:43.492639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:43.492639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:43.492639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:43.492639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:43.492639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:43.492639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:43.492639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:17:43.492639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:43.497596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 383/783] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Jun 16 17:17:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:43.498447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef252d3-8848-47e5-9577-327c01b9c0c1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:43.503681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0f038-0652-43e8-a829-6e8df15a7110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:43.504465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0f038-0652-43e8-a829-6e8df15a7110 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.504749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0f038-0652-43e8-a829-6e8df15a7110 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.505025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0f038-0652-43e8-a829-6e8df15a7110 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.505807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0f038-0652-43e8-a829-6e8df15a7110 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:43.506115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0f038-0652-43e8-a829-6e8df15a7110 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:43.507538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0f038-0652-43e8-a829-6e8df15a7110 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:43.520691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:43.525882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 401/784] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:43.527151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0f038-0652-43e8-a829-6e8df15a7110 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:43.592993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:43.619677 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef252d3-8848-47e5-9577-327c01b9c0c1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:43.641604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0f038-0652-43e8-a829-6e8df15a7110 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:43.656940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7bea3-ad8f-4b74-bd9b-a67e6d19207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:43.657669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bea3-ad8f-4b74-bd9b-a67e6d19207f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.657952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bea3-ad8f-4b74-bd9b-a67e6d19207f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.658229 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bea3-ad8f-4b74-bd9b-a67e6d19207f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.659006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7bea3-ad8f-4b74-bd9b-a67e6d19207f None admin] RBAC: Adding query filter params (interface=public, service_id=13540a32239a46aba75bc4b584e8a16f, region_id=RegionOne) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:43.659321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7bea3-ad8f-4b74-bd9b-a67e6d19207f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:43.660727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7bea3-ad8f-4b74-bd9b-a67e6d19207f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:43.669777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 384/785] 10.222.0.77 () {56 vars in 1251 bytes} [Thu Jun 16 17:17:43 2022] GET /identity/v3/endpoints?service_id=13540a32239a46aba75bc4b584e8a16f&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:43.675010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0860a-dbab-4162-b35c-d9b4862c4733 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.675296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0860a-dbab-4162-b35c-d9b4862c4733 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.675568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0860a-dbab-4162-b35c-d9b4862c4733 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.677035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 385/786] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:43.679005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b65c-612e-46cb-ab8a-cad7a695b639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:43.679681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b65c-612e-46cb-ab8a-cad7a695b639 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.679963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b65c-612e-46cb-ab8a-cad7a695b639 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.680267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b65c-612e-46cb-ab8a-cad7a695b639 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.681099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b65c-612e-46cb-ab8a-cad7a695b639 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:43.681436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b65c-612e-46cb-ab8a-cad7a695b639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:43.682209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0860a-dbab-4162-b35c-d9b4862c4733 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:43.683720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b65c-612e-46cb-ab8a-cad7a695b639 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:43.707170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 402/787] 10.222.0.77 () {56 vars in 1149 bytes} [Thu Jun 16 17:17:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:43.707170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b65c-612e-46cb-ab8a-cad7a695b639 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:43.773531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:43.793809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0860a-dbab-4162-b35c-d9b4862c4733 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:43.810911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b65c-612e-46cb-ab8a-cad7a695b639 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:43.826844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:43.830230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e51aa-5576-482e-832a-4e059cb2f9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:43.831134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e51aa-5576-482e-832a-4e059cb2f9b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.831417 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e51aa-5576-482e-832a-4e059cb2f9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.831688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e51aa-5576-482e-832a-4e059cb2f9b5 None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/ba0bb071b7c04e1da55259f079a9c805/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.833711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e51aa-5576-482e-832a-4e059cb2f9b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=ba0bb071b7c04e1da55259f079a9c805, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:43.835138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e51aa-5576-482e-832a-4e059cb2f9b5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:43.849858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de85d8-10f7-4280-ad97-37c77f0fb2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:43.850576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de85d8-10f7-4280-ad97-37c77f0fb2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.850868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de85d8-10f7-4280-ad97-37c77f0fb2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.855631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de85d8-10f7-4280-ad97-37c77f0fb2c6 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.855631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de85d8-10f7-4280-ad97-37c77f0fb2c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:43.855631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de85d8-10f7-4280-ad97-37c77f0fb2c6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:43.858823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 403/788] 10.222.0.77 () {56 vars in 1087 bytes} [Thu Jun 16 17:17:43 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:43.860114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7e859-a607-4e75-a6df-bb1584c85a42 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:43.860419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7e859-a607-4e75-a6df-bb1584c85a42 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:43.860699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7e859-a607-4e75-a6df-bb1584c85a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:43.883253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-f3c7e859-a607-4e75-a6df-bb1584c85a42 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:43.885259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f3c7e859-a607-4e75-a6df-bb1584c85a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:43.932508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 386/789] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:17:43 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/ba0bb071b7c04e1da55259f079a9c805/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:17:43.934602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e51aa-5576-482e-832a-4e059cb2f9b5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:43.977215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 404/790] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:44.003523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7e859-a607-4e75-a6df-bb1584c85a42 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:44.107302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e51aa-5576-482e-832a-4e059cb2f9b5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:44.131339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7e859-a607-4e75-a6df-bb1584c85a42 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:44.142438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:44.151930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a86e7-d30a-4d13-bd2b-91d7c232cc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:44.153862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a86e7-d30a-4d13-bd2b-91d7c232cc25 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.154359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a86e7-d30a-4d13-bd2b-91d7c232cc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.159091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a86e7-d30a-4d13-bd2b-91d7c232cc25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.167349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a86e7-d30a-4d13-bd2b-91d7c232cc25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:44.169462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a86e7-d30a-4d13-bd2b-91d7c232cc25 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:44.170444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee4269-e5fe-474d-9a6a-32ba5a11cee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:44.171256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee4269-e5fe-474d-9a6a-32ba5a11cee8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.171540 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee4269-e5fe-474d-9a6a-32ba5a11cee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.171812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee4269-e5fe-474d-9a6a-32ba5a11cee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.174180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:44.193309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee4269-e5fe-474d-9a6a-32ba5a11cee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-dc4a86e7-d30a-4d13-bd2b-91d7c232cc25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:44.195507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:44.196461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:44.198960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:44.198960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:44.198960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:44.198960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:44.198960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 387/791] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-e4ee4269-e5fe-474d-9a6a-32ba5a11cee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:44.199699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:44.201702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:44.203715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 405/792] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:44.212469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a86e7-d30a-4d13-bd2b-91d7c232cc25 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:44.212710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee4269-e5fe-474d-9a6a-32ba5a11cee8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:44.357408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a86e7-d30a-4d13-bd2b-91d7c232cc25 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:44.403024 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b229a6-f194-4d08-98a6-71fd1d74c7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:44.403694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b229a6-f194-4d08-98a6-71fd1d74c7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.403985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b229a6-f194-4d08-98a6-71fd1d74c7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.404285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b229a6-f194-4d08-98a6-71fd1d74c7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.405002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b229a6-f194-4d08-98a6-71fd1d74c7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:44.405304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b229a6-f194-4d08-98a6-71fd1d74c7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:44.406917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b229a6-f194-4d08-98a6-71fd1d74c7c9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:44.417695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee4269-e5fe-474d-9a6a-32ba5a11cee8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:44.422574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 388/793] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:44.423992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c38a-1987-485f-aa91-e33e87ac30ba None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.424305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c38a-1987-485f-aa91-e33e87ac30ba None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.424592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c38a-1987-485f-aa91-e33e87ac30ba None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.426689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 389/794] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:44.433114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169cae0-e7b3-4fcd-80ca-d2c20770270b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.433407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169cae0-e7b3-4fcd-80ca-d2c20770270b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.433686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169cae0-e7b3-4fcd-80ca-d2c20770270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.452922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1169cae0-e7b3-4fcd-80ca-d2c20770270b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:44.454437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1169cae0-e7b3-4fcd-80ca-d2c20770270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:44.455593 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfb047-1fd1-4ef4-a890-9f7016c77a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:44.456371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfb047-1fd1-4ef4-a890-9f7016c77a62 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.456652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfb047-1fd1-4ef4-a890-9f7016c77a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.456983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfb047-1fd1-4ef4-a890-9f7016c77a62 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.457733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfb047-1fd1-4ef4-a890-9f7016c77a62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:44.458037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfb047-1fd1-4ef4-a890-9f7016c77a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:44.459409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfb047-1fd1-4ef4-a890-9f7016c77a62 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:44.468790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 406/795] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:44.469627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfb047-1fd1-4ef4-a890-9f7016c77a62 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:44.504887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:44.516852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:44.535993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 390/796] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:44.536860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169cae0-e7b3-4fcd-80ca-d2c20770270b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:44.603819 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfb047-1fd1-4ef4-a890-9f7016c77a62 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:44.639395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06a12e-20d7-44b5-ae38-c1b8b6621ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:44.640601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06a12e-20d7-44b5-ae38-c1b8b6621ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.641104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06a12e-20d7-44b5-ae38-c1b8b6621ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.641575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06a12e-20d7-44b5-ae38-c1b8b6621ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.641924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169cae0-e7b3-4fcd-80ca-d2c20770270b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:44.648976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06a12e-20d7-44b5-ae38-c1b8b6621ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:44.651217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06a12e-20d7-44b5-ae38-c1b8b6621ce8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-cf06a12e-20d7-44b5-ae38-c1b8b6621ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:44.666534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:44.667541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:44.668461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:44.668461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:44.668461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:44.668461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:44.668461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:44.668461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:44.668461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:44.668461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:44.670892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 407/797] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:44.671872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06a12e-20d7-44b5-ae38-c1b8b6621ce8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:44.678736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dc42c-8956-4604-9fc2-4893f97e3a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:44.679546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dc42c-8956-4604-9fc2-4893f97e3a85 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.679831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dc42c-8956-4604-9fc2-4893f97e3a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.680129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dc42c-8956-4604-9fc2-4893f97e3a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.691459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dc42c-8956-4604-9fc2-4893f97e3a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:44.693059 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dc42c-8956-4604-9fc2-4893f97e3a85 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-9a8dc42c-8956-4604-9fc2-4893f97e3a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:44.715450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:44.716407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:44.717281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:44.717281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:44.717281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:44.717281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:44.721373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 391/798] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:44.722169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dc42c-8956-4604-9fc2-4893f97e3a85 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:44.761773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:44.771260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:44.781958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06a12e-20d7-44b5-ae38-c1b8b6621ce8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:44.819559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5943c-d5c5-48bc-999b-cdb69440b61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:44.820764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5943c-d5c5-48bc-999b-cdb69440b61b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.821249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5943c-d5c5-48bc-999b-cdb69440b61b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.821721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5943c-d5c5-48bc-999b-cdb69440b61b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.822702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5943c-d5c5-48bc-999b-cdb69440b61b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:44.824315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5943c-d5c5-48bc-999b-cdb69440b61b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-ccc5943c-d5c5-48bc-999b-cdb69440b61b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:44.837490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:44.847116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 17:17:44.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:44.848731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dc42c-8956-4604-9fc2-4893f97e3a85 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:44.848806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 408/799] 10.222.0.77 () {56 vars in 1129 bytes} [Thu Jun 16 17:17:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:44.848806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5943c-d5c5-48bc-999b-cdb69440b61b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:44.877943 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6083de-e67a-4ec3-ae0a-9237a4e71b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:44.878618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6083de-e67a-4ec3-ae0a-9237a4e71b46 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.878905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6083de-e67a-4ec3-ae0a-9237a4e71b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.879448 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6083de-e67a-4ec3-ae0a-9237a4e71b46 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.880065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6083de-e67a-4ec3-ae0a-9237a4e71b46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:44.880395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6083de-e67a-4ec3-ae0a-9237a4e71b46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:44.881832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6083de-e67a-4ec3-ae0a-9237a4e71b46 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:44.895394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 392/800] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:44.896439 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6083de-e67a-4ec3-ae0a-9237a4e71b46 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:44.955882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5943c-d5c5-48bc-999b-cdb69440b61b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:44.990858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e39fa7-4ee4-4ed3-aaf1-1eb3b87f9624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:44.991648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e39fa7-4ee4-4ed3-aaf1-1eb3b87f9624 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:44.992029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e39fa7-4ee4-4ed3-aaf1-1eb3b87f9624 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:44.992441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e39fa7-4ee4-4ed3-aaf1-1eb3b87f9624 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:44.993252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e39fa7-4ee4-4ed3-aaf1-1eb3b87f9624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:44.993656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e39fa7-4ee4-4ed3-aaf1-1eb3b87f9624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:44.995731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e39fa7-4ee4-4ed3-aaf1-1eb3b87f9624 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:45.004883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:45.013780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 409/801] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:45.013780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e39fa7-4ee4-4ed3-aaf1-1eb3b87f9624 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:45.017464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6083de-e67a-4ec3-ae0a-9237a4e71b46 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:45.037303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:45.081810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f05c0-8dae-467b-b420-201bb376ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:45.082675 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f05c0-8dae-467b-b420-201bb376ae64 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:45.083096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f05c0-8dae-467b-b420-201bb376ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:45.083907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f05c0-8dae-467b-b420-201bb376ae64 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:45.085022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f05c0-8dae-467b-b420-201bb376ae64 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:45.085433 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f05c0-8dae-467b-b420-201bb376ae64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:45.087222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f05c0-8dae-467b-b420-201bb376ae64 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:45.096464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 393/802] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Jun 16 17:17:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:45.097477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f05c0-8dae-467b-b420-201bb376ae64 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:45.161063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e39fa7-4ee4-4ed3-aaf1-1eb3b87f9624 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:45.211434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0358173-f29f-4c08-8aad-bf70a32ac860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:45.213126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0358173-f29f-4c08-8aad-bf70a32ac860 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:45.213730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0358173-f29f-4c08-8aad-bf70a32ac860 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:45.214080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0358173-f29f-4c08-8aad-bf70a32ac860 None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/9f9b0c02f87340998d1736f2062b7164/roles/2e0782565f884df9ba31ae571e465e25` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:45.215943 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f05c0-8dae-467b-b420-201bb376ae64 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:45.235100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0358173-f29f-4c08-8aad-bf70a32ac860 None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=9f9b0c02f87340998d1736f2062b7164, role_id=2e0782565f884df9ba31ae571e465e25)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:45.236954 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0358173-f29f-4c08-8aad-bf70a32ac860 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:45.263769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf9e7a-7bb1-4584-8a70-cb0614745f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:45.263769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf9e7a-7bb1-4584-8a70-cb0614745f66 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:45.263769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf9e7a-7bb1-4584-8a70-cb0614745f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:45.263769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf9e7a-7bb1-4584-8a70-cb0614745f66 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:45.270535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf9e7a-7bb1-4584-8a70-cb0614745f66 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:45.271983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf9e7a-7bb1-4584-8a70-cb0614745f66 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-42bf9e7a-7bb1-4584-8a70-cb0614745f66 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:45.286861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:45.287827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 394/803] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:45.289521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf9e7a-7bb1-4584-8a70-cb0614745f66 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:45.316130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:45.340106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 410/804] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:17:45 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/9f9b0c02f87340998d1736f2062b7164/roles/2e0782565f884df9ba31ae571e465e25 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:17:45.340106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0358173-f29f-4c08-8aad-bf70a32ac860 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:45.470324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:45.591184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0358173-f29f-4c08-8aad-bf70a32ac860 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:45.604710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf9e7a-7bb1-4584-8a70-cb0614745f66 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:45.642660 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddc19-b792-4782-812a-f31cdbd9eaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:45.643337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddc19-b792-4782-812a-f31cdbd9eaad None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:45.643615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddc19-b792-4782-812a-f31cdbd9eaad None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:45.643885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddc19-b792-4782-812a-f31cdbd9eaad None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:45.644613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddc19-b792-4782-812a-f31cdbd9eaad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:45.644915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddc19-b792-4782-812a-f31cdbd9eaad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:45.646071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c13f-ea6e-43da-b783-b16b9746589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:45.646518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddc19-b792-4782-812a-f31cdbd9eaad None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:45.646827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c13f-ea6e-43da-b783-b16b9746589c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:45.647190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c13f-ea6e-43da-b783-b16b9746589c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:45.647637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c13f-ea6e-43da-b783-b16b9746589c None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:45.648727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c13f-ea6e-43da-b783-b16b9746589c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:45.649113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c13f-ea6e-43da-b783-b16b9746589c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:45.650818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c13f-ea6e-43da-b783-b16b9746589c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:45.651927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 395/805] 10.222.0.77 () {56 vars in 1124 bytes} [Thu Jun 16 17:17:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:45.659213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddc19-b792-4782-812a-f31cdbd9eaad None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:45.676896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 411/806] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Jun 16 17:17:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:45.682762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c13f-ea6e-43da-b783-b16b9746589c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:45.774151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:45.792521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddc19-b792-4782-812a-f31cdbd9eaad None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:45.830035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057a65a-7c93-4b21-a10d-73e9e424f1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:45.830937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057a65a-7c93-4b21-a10d-73e9e424f1ca None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:45.831390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057a65a-7c93-4b21-a10d-73e9e424f1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:45.831819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057a65a-7c93-4b21-a10d-73e9e424f1ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:45.832735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057a65a-7c93-4b21-a10d-73e9e424f1ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:45.834379 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057a65a-7c93-4b21-a10d-73e9e424f1ca None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:45.879163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c13f-ea6e-43da-b783-b16b9746589c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:45.908201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:45.920785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81e102-68ee-4075-9619-4e675be7700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:45.921871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e102-68ee-4075-9619-4e675be7700f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:45.922341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e102-68ee-4075-9619-4e675be7700f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:45.922807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e102-68ee-4075-9619-4e675be7700f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:45.940211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 396/807] 10.222.0.77 () {60 vars in 1144 bytes} [Thu Jun 16 17:17:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:45.942019 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81e102-68ee-4075-9619-4e675be7700f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:45.946350 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81e102-68ee-4075-9619-4e675be7700f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-0f81e102-68ee-4075-9619-4e675be7700f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:45.965928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:45.967233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:45.968362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:45.968362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:45.968362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:45.968362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:45.968362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 412/808] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:45.973272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057a65a-7c93-4b21-a10d-73e9e424f1ca None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:46.129432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057a65a-7c93-4b21-a10d-73e9e424f1ca None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:46.170119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ebf71-915c-4cba-9edf-582be6e33c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:46.170786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ebf71-915c-4cba-9edf-582be6e33c7a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:46.171065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ebf71-915c-4cba-9edf-582be6e33c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:46.171339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ebf71-915c-4cba-9edf-582be6e33c7a None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:46.172053 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ebf71-915c-4cba-9edf-582be6e33c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:46.172395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ebf71-915c-4cba-9edf-582be6e33c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:46.173818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ebf71-915c-4cba-9edf-582be6e33c7a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:46.176247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:46.187762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 397/809] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:46.193395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81e102-68ee-4075-9619-4e675be7700f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:46.299982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81e102-68ee-4075-9619-4e675be7700f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:46.335761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac40e-8b64-4575-84ad-37708b429bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:46.336656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac40e-8b64-4575-84ad-37708b429bbf None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:46.336945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac40e-8b64-4575-84ad-37708b429bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:46.337219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac40e-8b64-4575-84ad-37708b429bbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:46.345259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ac40e-8b64-4575-84ad-37708b429bbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:46.346702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ac40e-8b64-4575-84ad-37708b429bbf None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-895ac40e-8b64-4575-84ad-37708b429bbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:46.361349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:46.362270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:46.363570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:46.363570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:46.363570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:46.363570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:46.363570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:46.363570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:46.363570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:46.363570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:46.363570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 413/810] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:46.368537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ebf71-915c-4cba-9edf-582be6e33c7a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:46.466137 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3808-1982-4597-b9f9-a1f55d5f8574 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:46.466490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3808-1982-4597-b9f9-a1f55d5f8574 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:46.466698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3808-1982-4597-b9f9-a1f55d5f8574 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:46.468415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 414/811] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:46.477942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eba3f-1f19-429d-874a-9e4bc53fe330 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:46.478335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eba3f-1f19-429d-874a-9e4bc53fe330 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:46.478671 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eba3f-1f19-429d-874a-9e4bc53fe330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:46.507439 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ebf71-915c-4cba-9edf-582be6e33c7a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:46.518915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-826eba3f-1f19-429d-874a-9e4bc53fe330 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:46.520426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-826eba3f-1f19-429d-874a-9e4bc53fe330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:46.559431 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76b4b-8c7e-4e55-811b-b0e07e467185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:46.560154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76b4b-8c7e-4e55-811b-b0e07e467185 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:46.560471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76b4b-8c7e-4e55-811b-b0e07e467185 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:46.560766 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76b4b-8c7e-4e55-811b-b0e07e467185 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:46.561553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76b4b-8c7e-4e55-811b-b0e07e467185 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:46.561871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76b4b-8c7e-4e55-811b-b0e07e467185 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:46.563354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76b4b-8c7e-4e55-811b-b0e07e467185 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:46.576446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:46.584025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 398/812] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:46.586177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df290d1-6e78-402c-b5f8-db09b01b5b68 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:46.586654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df290d1-6e78-402c-b5f8-db09b01b5b68 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:46.587102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df290d1-6e78-402c-b5f8-db09b01b5b68 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:46.590093 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 399/813] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:46.594493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df290d1-6e78-402c-b5f8-db09b01b5b68 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:46.608138 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 415/814] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:46.610207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7387a-e2f5-46ef-b80a-eca19e9dfb9e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:46.610901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7387a-e2f5-46ef-b80a-eca19e9dfb9e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:46.611801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7387a-e2f5-46ef-b80a-eca19e9dfb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:46.648813 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-62f7387a-e2f5-46ef-b80a-eca19e9dfb9e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:46.652306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-62f7387a-e2f5-46ef-b80a-eca19e9dfb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:46.683313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:46.742917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 416/815] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:46.745657 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df290d1-6e78-402c-b5f8-db09b01b5b68 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:46.745796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7387a-e2f5-46ef-b80a-eca19e9dfb9e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:46.786110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a85f5c-915f-4f6b-a870-f313d9bbf5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:46.787023 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a85f5c-915f-4f6b-a870-f313d9bbf5bb None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:46.787301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a85f5c-915f-4f6b-a870-f313d9bbf5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:46.787569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a85f5c-915f-4f6b-a870-f313d9bbf5bb None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/e3c319430309419c895a0dc3c90ce80e/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:46.790312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a85f5c-915f-4f6b-a870-f313d9bbf5bb None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=e3c319430309419c895a0dc3c90ce80e, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:46.793739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a85f5c-915f-4f6b-a870-f313d9bbf5bb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:46.875595 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:46.884210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7387a-e2f5-46ef-b80a-eca19e9dfb9e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:46.892344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 400/816] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:17:46 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/e3c319430309419c895a0dc3c90ce80e/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:17:46.892344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a85f5c-915f-4f6b-a870-f313d9bbf5bb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:46.958252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99110a-6a4c-46bc-8771-7a91d5896e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:46.958252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99110a-6a4c-46bc-8771-7a91d5896e14 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:46.958648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99110a-6a4c-46bc-8771-7a91d5896e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:46.958887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99110a-6a4c-46bc-8771-7a91d5896e14 None admin] PATH_INFO: `/v3/services/network` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:46.960457 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99110a-6a4c-46bc-8771-7a91d5896e14 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:46.963231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99110a-6a4c-46bc-8771-7a91d5896e14 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-3d99110a-6a4c-46bc-8771-7a91d5896e14 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:46.985220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:46.987256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 17:17:46.988996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:46.993159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 417/817] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:46 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:46.998336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99110a-6a4c-46bc-8771-7a91d5896e14 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:47.113246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a85f5c-915f-4f6b-a870-f313d9bbf5bb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:47.132551 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:47.155581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1449-490b-4a89-bcd7-962295b7fe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:47.156479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1449-490b-4a89-bcd7-962295b7fe28 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:47.156755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1449-490b-4a89-bcd7-962295b7fe28 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:47.157111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1449-490b-4a89-bcd7-962295b7fe28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:47.169466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad1449-490b-4a89-bcd7-962295b7fe28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-97ad1449-490b-4a89-bcd7-962295b7fe28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:47.179252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:47.180278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:47.181368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 401/818] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:47.189307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1449-490b-4a89-bcd7-962295b7fe28 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:47.197845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99110a-6a4c-46bc-8771-7a91d5896e14 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:47.238703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a17505-247c-4abc-99aa-b31f3443298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:47.239744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a17505-247c-4abc-99aa-b31f3443298f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:47.240340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a17505-247c-4abc-99aa-b31f3443298f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:47.240811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a17505-247c-4abc-99aa-b31f3443298f None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:47.241711 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a17505-247c-4abc-99aa-b31f3443298f None admin] RBAC: Adding query filter params (name=network) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:47.242209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a17505-247c-4abc-99aa-b31f3443298f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:47.244525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a17505-247c-4abc-99aa-b31f3443298f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:47.250334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 418/819] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:17:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:47.255488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a17505-247c-4abc-99aa-b31f3443298f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:47.316436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:47.383541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1449-490b-4a89-bcd7-962295b7fe28 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:47.411410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a17505-247c-4abc-99aa-b31f3443298f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:47.456687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7d9fd-fa00-4d9d-b65f-975d4686dbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:47.457697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7d9fd-fa00-4d9d-b65f-975d4686dbfb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:47.458176 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7d9fd-fa00-4d9d-b65f-975d4686dbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:47.458638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7d9fd-fa00-4d9d-b65f-975d4686dbfb None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:47.459544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7d9fd-fa00-4d9d-b65f-975d4686dbfb None admin] RBAC: Adding query filter params (type=network) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:47.460033 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7d9fd-fa00-4d9d-b65f-975d4686dbfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:47.461674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7d9fd-fa00-4d9d-b65f-975d4686dbfb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:47.465690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3739c1-808c-410c-87c4-811b3cc444e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:47.466377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3739c1-808c-410c-87c4-811b3cc444e1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:47.466653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3739c1-808c-410c-87c4-811b3cc444e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:47.466926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3739c1-808c-410c-87c4-811b3cc444e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:47.467676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3739c1-808c-410c-87c4-811b3cc444e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:47.467980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3739c1-808c-410c-87c4-811b3cc444e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:47.469387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3739c1-808c-410c-87c4-811b3cc444e1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:47.469630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 419/820] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:17:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:47.477147 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7d9fd-fa00-4d9d-b65f-975d4686dbfb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:47.490454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 402/821] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:47.497542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3739c1-808c-410c-87c4-811b3cc444e1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:47.568649 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:47.589158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:47.606963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7d9fd-fa00-4d9d-b65f-975d4686dbfb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:47.651891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d802-02ae-4454-8146-497d58c2f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:47.654239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d802-02ae-4454-8146-497d58c2f669 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:47.654735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d802-02ae-4454-8146-497d58c2f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:47.655231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d802-02ae-4454-8146-497d58c2f669 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:47.656188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337d802-02ae-4454-8146-497d58c2f669 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:47.657762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337d802-02ae-4454-8146-497d58c2f669 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:47.700408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3739c1-808c-410c-87c4-811b3cc444e1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:47.740430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab86c66-6e04-4218-8e7f-6b56164e6fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:47.741705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86c66-6e04-4218-8e7f-6b56164e6fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:47.742341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86c66-6e04-4218-8e7f-6b56164e6fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:47.742859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86c66-6e04-4218-8e7f-6b56164e6fe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:47.752185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 420/822] 10.222.0.77 () {60 vars in 1144 bytes} [Thu Jun 16 17:17:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:47.767050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab86c66-6e04-4218-8e7f-6b56164e6fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:47.768956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab86c66-6e04-4218-8e7f-6b56164e6fe1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6ab86c66-6e04-4218-8e7f-6b56164e6fe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:47.789339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:47.790348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:47.791918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:47.791918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:47.791918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:47.791918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:47.794068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 403/823] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:47.799432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d802-02ae-4454-8146-497d58c2f669 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:47.966076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d802-02ae-4454-8146-497d58c2f669 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:48.010782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949a04-2c21-4f1b-8ef4-db029e7b28bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:48.011730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949a04-2c21-4f1b-8ef4-db029e7b28bb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.012206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949a04-2c21-4f1b-8ef4-db029e7b28bb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.012651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949a04-2c21-4f1b-8ef4-db029e7b28bb None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.013800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949a04-2c21-4f1b-8ef4-db029e7b28bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:48.014285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949a04-2c21-4f1b-8ef4-db029e7b28bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:48.015833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949a04-2c21-4f1b-8ef4-db029e7b28bb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:48.024096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:48.031878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 421/824] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:48.037005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab86c66-6e04-4218-8e7f-6b56164e6fe1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:48.043502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45ad5-d5db-40f5-bbd2-742d92d977fd None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.043794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45ad5-d5db-40f5-bbd2-742d92d977fd None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.044089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45ad5-d5db-40f5-bbd2-742d92d977fd None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.045722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 422/825] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:48.051433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040332c4-d9b7-459b-9298-77f7952a3dba None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.051713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040332c4-d9b7-459b-9298-77f7952a3dba None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.051993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040332c4-d9b7-459b-9298-77f7952a3dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.072708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-040332c4-d9b7-459b-9298-77f7952a3dba None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:48.074069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-040332c4-d9b7-459b-9298-77f7952a3dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:48.168299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 423/826] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:17:48.190010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:48.200866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040332c4-d9b7-459b-9298-77f7952a3dba None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:48.207350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab86c66-6e04-4218-8e7f-6b56164e6fe1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:48.257724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05dc3-ef83-4682-8b43-b50c58e8320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:48.258969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05dc3-ef83-4682-8b43-b50c58e8320a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.260171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05dc3-ef83-4682-8b43-b50c58e8320a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.261104 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05dc3-ef83-4682-8b43-b50c58e8320a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.272396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea05dc3-ef83-4682-8b43-b50c58e8320a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:48.274215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea05dc3-ef83-4682-8b43-b50c58e8320a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7ea05dc3-ef83-4682-8b43-b50c58e8320a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:48.296500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:48.297513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:48.298460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:48.298460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:48.298460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:48.298460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:48.298460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:48.298460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:48.298460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:48.298460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:48.298460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:17:48.298460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:48.302136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 404/827] 10.222.0.77 () {56 vars in 1093 bytes} [Thu Jun 16 17:17:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:48.308456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05dc3-ef83-4682-8b43-b50c58e8320a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:48.375651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040332c4-d9b7-459b-9298-77f7952a3dba None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:48.418698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:48.428382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896138d2-cf38-4fa3-85ab-26ad6e0c1b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:48.429442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896138d2-cf38-4fa3-85ab-26ad6e0c1b8f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.432259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896138d2-cf38-4fa3-85ab-26ad6e0c1b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.432259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896138d2-cf38-4fa3-85ab-26ad6e0c1b8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.432451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05dc3-ef83-4682-8b43-b50c58e8320a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:48.442512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896138d2-cf38-4fa3-85ab-26ad6e0c1b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-896138d2-cf38-4fa3-85ab-26ad6e0c1b8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:48.452050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:48.453023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:17:48.453835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:48.457858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 424/828] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:17:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:48.464306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896138d2-cf38-4fa3-85ab-26ad6e0c1b8f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:48.477126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b35403-0256-4b48-89b5-4007f7e91540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:48.477907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b35403-0256-4b48-89b5-4007f7e91540 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.478280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b35403-0256-4b48-89b5-4007f7e91540 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.478556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b35403-0256-4b48-89b5-4007f7e91540 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.479695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b35403-0256-4b48-89b5-4007f7e91540 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:48.480038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b35403-0256-4b48-89b5-4007f7e91540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:48.481694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b35403-0256-4b48-89b5-4007f7e91540 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:48.503719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 405/829] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Jun 16 17:17:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:48.509920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b35403-0256-4b48-89b5-4007f7e91540 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:48.522600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:48.578634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896138d2-cf38-4fa3-85ab-26ad6e0c1b8f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:48.614066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455e0d5-a7ed-4714-83c6-e928eb00c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:48.614644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455e0d5-a7ed-4714-83c6-e928eb00c9ca None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.614916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455e0d5-a7ed-4714-83c6-e928eb00c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.615192 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455e0d5-a7ed-4714-83c6-e928eb00c9ca None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.615929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455e0d5-a7ed-4714-83c6-e928eb00c9ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:48.616264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455e0d5-a7ed-4714-83c6-e928eb00c9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:48.617638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455e0d5-a7ed-4714-83c6-e928eb00c9ca None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:48.625412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b35403-0256-4b48-89b5-4007f7e91540 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:48.625566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 425/830] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:17:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:48.626692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd42e-5cc0-40dc-bdaa-eddc21f28ff9 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.626977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd42e-5cc0-40dc-bdaa-eddc21f28ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.627254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd42e-5cc0-40dc-bdaa-eddc21f28ff9 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.632339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 426/831] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:48.633091 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fd42e-5cc0-40dc-bdaa-eddc21f28ff9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:48.668378 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b096e0c-1a3a-46bd-9c41-f3daca343e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:48.669027 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b096e0c-1a3a-46bd-9c41-f3daca343e5e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.669306 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b096e0c-1a3a-46bd-9c41-f3daca343e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.669577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b096e0c-1a3a-46bd-9c41-f3daca343e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.687885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:48.738846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fd42e-5cc0-40dc-bdaa-eddc21f28ff9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:48.742757 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b096e0c-1a3a-46bd-9c41-f3daca343e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:48.744787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b096e0c-1a3a-46bd-9c41-f3daca343e5e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:48.754792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:48.774854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b89b6e-a417-4380-b67a-c0cf8683a0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:48.776149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b89b6e-a417-4380-b67a-c0cf8683a0ff None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.776433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b89b6e-a417-4380-b67a-c0cf8683a0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.776709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b89b6e-a417-4380-b67a-c0cf8683a0ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.788600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b89b6e-a417-4380-b67a-c0cf8683a0ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:48.790033 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b89b6e-a417-4380-b67a-c0cf8683a0ff None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b4b89b6e-a417-4380-b67a-c0cf8683a0ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:48.808290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:48.809396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:48.810303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:48.810303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:48.810303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:48.810303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:48.810303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 427/832] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:48.810676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70146f53-c596-47c9-b094-e9b57bd74a4b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:48.810966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70146f53-c596-47c9-b094-e9b57bd74a4b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:48.811246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70146f53-c596-47c9-b094-e9b57bd74a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:48.829717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-70146f53-c596-47c9-b094-e9b57bd74a4b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:48.830912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-70146f53-c596-47c9-b094-e9b57bd74a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:48.862185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 406/833] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:17:48.863261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b096e0c-1a3a-46bd-9c41-f3daca343e5e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:48.906385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 428/834] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:48.907229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70146f53-c596-47c9-b094-e9b57bd74a4b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:48.940524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:48.982417 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b096e0c-1a3a-46bd-9c41-f3daca343e5e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:48.991911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:49.014136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70146f53-c596-47c9-b094-e9b57bd74a4b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:49.018512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad79b51-f62c-43e4-ab29-6cb0318749b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.019235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad79b51-f62c-43e4-ab29-6cb0318749b4 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.019522 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad79b51-f62c-43e4-ab29-6cb0318749b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.019807 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad79b51-f62c-43e4-ab29-6cb0318749b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.020555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad79b51-f62c-43e4-ab29-6cb0318749b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:49.020869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad79b51-f62c-43e4-ab29-6cb0318749b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.022235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad79b51-f62c-43e4-ab29-6cb0318749b4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:49.034869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 407/835] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:49.039973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad79b51-f62c-43e4-ab29-6cb0318749b4 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:49.051607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c409c7-7d07-4a06-a0ba-821880f90c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.052445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c409c7-7d07-4a06-a0ba-821880f90c5c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.052731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c409c7-7d07-4a06-a0ba-821880f90c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.053004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c409c7-7d07-4a06-a0ba-821880f90c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.063626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c409c7-7d07-4a06-a0ba-821880f90c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.065107 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c409c7-7d07-4a06-a0ba-821880f90c5c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-96c409c7-7d07-4a06-a0ba-821880f90c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:49.083831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:49.084777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:49.085672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:49.085672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:49.085672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:49.085672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:49.085672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 429/836] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:49.085947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c409c7-7d07-4a06-a0ba-821880f90c5c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:49.156442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad79b51-f62c-43e4-ab29-6cb0318749b4 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:49.177795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:49.191618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cabcc-d389-4de1-8b3a-c514c03e0415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.196653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cabcc-d389-4de1-8b3a-c514c03e0415 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.196653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cabcc-d389-4de1-8b3a-c514c03e0415 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.196653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cabcc-d389-4de1-8b3a-c514c03e0415 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.196653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cabcc-d389-4de1-8b3a-c514c03e0415 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.197165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c409c7-7d07-4a06-a0ba-821880f90c5c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:49.197242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cabcc-d389-4de1-8b3a-c514c03e0415 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d81cabcc-d389-4de1-8b3a-c514c03e0415 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:49.206927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:49.213525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:49.214482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 408/837] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:49.215255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cabcc-d389-4de1-8b3a-c514c03e0415 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:49.239673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0344653-7610-4907-b37b-ce53d1516b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.240614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344653-7610-4907-b37b-ce53d1516b99 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.240966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344653-7610-4907-b37b-ce53d1516b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.241254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344653-7610-4907-b37b-ce53d1516b99 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.247852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:49.249219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0344653-7610-4907-b37b-ce53d1516b99 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.250675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0344653-7610-4907-b37b-ce53d1516b99 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-c0344653-7610-4907-b37b-ce53d1516b99 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:49.266793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:49.267760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:49.268709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 430/838] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Jun 16 17:17:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:49.269297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0344653-7610-4907-b37b-ce53d1516b99 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:49.323481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cabcc-d389-4de1-8b3a-c514c03e0415 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:49.359505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb720c-e4c0-492f-9fad-653b0aa537d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.360474 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb720c-e4c0-492f-9fad-653b0aa537d5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.360923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb720c-e4c0-492f-9fad-653b0aa537d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.361357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb720c-e4c0-492f-9fad-653b0aa537d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.362244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb720c-e4c0-492f-9fad-653b0aa537d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:49.362554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb720c-e4c0-492f-9fad-653b0aa537d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.364181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb720c-e4c0-492f-9fad-653b0aa537d5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:49.378625 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0344653-7610-4907-b37b-ce53d1516b99 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:49.383782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 409/839] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:49.383782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb720c-e4c0-492f-9fad-653b0aa537d5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:49.419302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bc2fe-a96a-4fd8-b94d-d754f5cda8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.419980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bc2fe-a96a-4fd8-b94d-d754f5cda8dc None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.420290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bc2fe-a96a-4fd8-b94d-d754f5cda8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.420576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bc2fe-a96a-4fd8-b94d-d754f5cda8dc None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.421283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bc2fe-a96a-4fd8-b94d-d754f5cda8dc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:49.421593 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bc2fe-a96a-4fd8-b94d-d754f5cda8dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.422961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bc2fe-a96a-4fd8-b94d-d754f5cda8dc None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:49.427573 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 431/840] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:49.428382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bc2fe-a96a-4fd8-b94d-d754f5cda8dc None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:49.487517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:49.497728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb720c-e4c0-492f-9fad-653b0aa537d5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:49.537219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5782ef-04ff-4cc1-be5a-d66872212b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.537910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5782ef-04ff-4cc1-be5a-d66872212b24 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.538220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5782ef-04ff-4cc1-be5a-d66872212b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.538500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5782ef-04ff-4cc1-be5a-d66872212b24 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.539337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5782ef-04ff-4cc1-be5a-d66872212b24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:49.539647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5782ef-04ff-4cc1-be5a-d66872212b24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.542300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5782ef-04ff-4cc1-be5a-d66872212b24 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:49.561587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:49.562493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 410/841] 10.222.0.77 () {56 vars in 1149 bytes} [Thu Jun 16 17:17:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:49.563378 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5782ef-04ff-4cc1-be5a-d66872212b24 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:49.659857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bc2fe-a96a-4fd8-b94d-d754f5cda8dc None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:49.666892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5782ef-04ff-4cc1-be5a-d66872212b24 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:49.693817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53170a9-f2c1-4965-acd8-ed6475581d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.694611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53170a9-f2c1-4965-acd8-ed6475581d95 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.694888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53170a9-f2c1-4965-acd8-ed6475581d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.695160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53170a9-f2c1-4965-acd8-ed6475581d95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.700448 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6bb9b-c8f1-4a5a-ad10-b8f9ad131020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.701116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6bb9b-c8f1-4a5a-ad10-b8f9ad131020 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.701403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6bb9b-c8f1-4a5a-ad10-b8f9ad131020 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.701683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6bb9b-c8f1-4a5a-ad10-b8f9ad131020 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.702379 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6bb9b-c8f1-4a5a-ad10-b8f9ad131020 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:49.702545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53170a9-f2c1-4965-acd8-ed6475581d95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.702688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6bb9b-c8f1-4a5a-ad10-b8f9ad131020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.703968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53170a9-f2c1-4965-acd8-ed6475581d95 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:49.704057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6bb9b-c8f1-4a5a-ad10-b8f9ad131020 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:49.708549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 411/842] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:49.709810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3020a6-a50c-4a46-b517-31fe08fe6105 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.710099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3020a6-a50c-4a46-b517-31fe08fe6105 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.710382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3020a6-a50c-4a46-b517-31fe08fe6105 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.716236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 412/843] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:49.716236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3020a6-a50c-4a46-b517-31fe08fe6105 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b53170a9-f2c1-4965-acd8-ed6475581d95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:49.718161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:49.719102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:49.719995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:49.719995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:49.719995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:49.719995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:49.719995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:49.719995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:49.719995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:49.719995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:49.719995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 432/844] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:49.720789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fe80b-d5a0-493b-9f8a-806322ea086a None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.721066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fe80b-d5a0-493b-9f8a-806322ea086a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.721352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fe80b-d5a0-493b-9f8a-806322ea086a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.747539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6e3fe80b-d5a0-493b-9f8a-806322ea086a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:49.749203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:49.749663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6e3fe80b-d5a0-493b-9f8a-806322ea086a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:49.826676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:49.840196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 433/845] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:49.840196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fe80b-d5a0-493b-9f8a-806322ea086a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:49.878261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3020a6-a50c-4a46-b517-31fe08fe6105 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:49.915342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567027b6-ef89-49af-96cd-bdb152ffd57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.916875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567027b6-ef89-49af-96cd-bdb152ffd57c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.917161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567027b6-ef89-49af-96cd-bdb152ffd57c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.917492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567027b6-ef89-49af-96cd-bdb152ffd57c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.946722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fe80b-d5a0-493b-9f8a-806322ea086a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:49.984772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f787df-f56b-4905-93a8-fa4e515e65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:49.985553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f787df-f56b-4905-93a8-fa4e515e65cb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:49.985838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f787df-f56b-4905-93a8-fa4e515e65cb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:49.986112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f787df-f56b-4905-93a8-fa4e515e65cb None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:49.987016 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f787df-f56b-4905-93a8-fa4e515e65cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:49.987325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f787df-f56b-4905-93a8-fa4e515e65cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.988775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f787df-f56b-4905-93a8-fa4e515e65cb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:49.988894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567027b6-ef89-49af-96cd-bdb152ffd57c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:49.990213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567027b6-ef89-49af-96cd-bdb152ffd57c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:50.001623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 434/846] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:50.002767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f787df-f56b-4905-93a8-fa4e515e65cb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.010227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:50.064318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:50.104810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 413/847] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:17:50.104810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567027b6-ef89-49af-96cd-bdb152ffd57c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.114635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f787df-f56b-4905-93a8-fa4e515e65cb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:50.151463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabbe21-edfb-4b3c-982e-1ef1aec010fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:50.152401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabbe21-edfb-4b3c-982e-1ef1aec010fe None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:50.152686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabbe21-edfb-4b3c-982e-1ef1aec010fe None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:50.152966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabbe21-edfb-4b3c-982e-1ef1aec010fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:50.164211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabbe21-edfb-4b3c-982e-1ef1aec010fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-edabbe21-edfb-4b3c-982e-1ef1aec010fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:50.172707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:50.173641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:50.174463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 435/848] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:50.175156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabbe21-edfb-4b3c-982e-1ef1aec010fe None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.215140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567027b6-ef89-49af-96cd-bdb152ffd57c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:50.230888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:50.254335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a047fa-786f-435a-9fd1-5c13084bc5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:50.254995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a047fa-786f-435a-9fd1-5c13084bc5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:50.255278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a047fa-786f-435a-9fd1-5c13084bc5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:50.255553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a047fa-786f-435a-9fd1-5c13084bc5e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:50.256408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a047fa-786f-435a-9fd1-5c13084bc5e9 None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=ba0bb071b7c04e1da55259f079a9c805) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:50.256721 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a047fa-786f-435a-9fd1-5c13084bc5e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:50.258150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a047fa-786f-435a-9fd1-5c13084bc5e9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:50.272114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 414/849] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/role_assignments?user.id=ba0bb071b7c04e1da55259f079a9c805&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:50.272114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a047fa-786f-435a-9fd1-5c13084bc5e9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.309495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabbe21-edfb-4b3c-982e-1ef1aec010fe None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:50.336415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:50.371681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d4be1-6c3f-4626-9e58-78a96de98290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:50.372740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d4be1-6c3f-4626-9e58-78a96de98290 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:50.373030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d4be1-6c3f-4626-9e58-78a96de98290 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:50.373309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d4be1-6c3f-4626-9e58-78a96de98290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:50.392032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d4be1-6c3f-4626-9e58-78a96de98290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:50.394199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d4be1-6c3f-4626-9e58-78a96de98290 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:50.395208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a047fa-786f-435a-9fd1-5c13084bc5e9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-bf5d4be1-6c3f-4626-9e58-78a96de98290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:50.420804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:50.421757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:50.422667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:50.422667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:50.422667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:50.422667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:50.423218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 436/850] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:50.428330 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d4be1-6c3f-4626-9e58-78a96de98290 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.439101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae48137-6cd6-4c70-b3f0-2c2c800d9dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:50.440111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae48137-6cd6-4c70-b3f0-2c2c800d9dfa None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:50.440610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae48137-6cd6-4c70-b3f0-2c2c800d9dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:50.441117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae48137-6cd6-4c70-b3f0-2c2c800d9dfa None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:50.442074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae48137-6cd6-4c70-b3f0-2c2c800d9dfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:50.442587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae48137-6cd6-4c70-b3f0-2c2c800d9dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:50.444954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae48137-6cd6-4c70-b3f0-2c2c800d9dfa None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:50.457705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 415/851] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:50.464542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae48137-6cd6-4c70-b3f0-2c2c800d9dfa None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.520308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:50.567950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d4be1-6c3f-4626-9e58-78a96de98290 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:50.589506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae48137-6cd6-4c70-b3f0-2c2c800d9dfa None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:50.613131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ef17b-1a88-4ae1-87db-875cb580e42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:50.614118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ef17b-1a88-4ae1-87db-875cb580e42d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:50.614406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ef17b-1a88-4ae1-87db-875cb580e42d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:50.614808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ef17b-1a88-4ae1-87db-875cb580e42d None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:50.615657 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ef17b-1a88-4ae1-87db-875cb580e42d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:50.615971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ef17b-1a88-4ae1-87db-875cb580e42d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:50.618112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ef17b-1a88-4ae1-87db-875cb580e42d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:50.625594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e81f5f-749e-4b8f-a635-0c68cad1e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:50.626509 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e81f5f-749e-4b8f-a635-0c68cad1e7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:50.626901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e81f5f-749e-4b8f-a635-0c68cad1e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:50.627284 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e81f5f-749e-4b8f-a635-0c68cad1e7f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:50.632996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 437/852] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:50.639569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ef17b-1a88-4ae1-87db-875cb580e42d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.641006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e81f5f-749e-4b8f-a635-0c68cad1e7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:50.642526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e81f5f-749e-4b8f-a635-0c68cad1e7f4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-f3e81f5f-749e-4b8f-a635-0c68cad1e7f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:50.663737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:50.664880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:50.665986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:50.665986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:50.665986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:50.665986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:50.670308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 416/853] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:50.673028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e81f5f-749e-4b8f-a635-0c68cad1e7f4 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.676944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:50.775342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ef17b-1a88-4ae1-87db-875cb580e42d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:50.797116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:50.810231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e81f5f-749e-4b8f-a635-0c68cad1e7f4 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:50.830151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b732c5b-8961-437d-9d5a-465cde7162bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:50.831543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b732c5b-8961-437d-9d5a-465cde7162bb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:50.832163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b732c5b-8961-437d-9d5a-465cde7162bb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:50.832641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b732c5b-8961-437d-9d5a-465cde7162bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:50.844988 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b732c5b-8961-437d-9d5a-465cde7162bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:50.850610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b732c5b-8961-437d-9d5a-465cde7162bb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:50.850743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a5c29-1f7e-45e1-b8cb-20a8807fd44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:50.851201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a5c29-1f7e-45e1-b8cb-20a8807fd44b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:50.851609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a5c29-1f7e-45e1-b8cb-20a8807fd44b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:50.851952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a5c29-1f7e-45e1-b8cb-20a8807fd44b None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:50.852860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a5c29-1f7e-45e1-b8cb-20a8807fd44b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:50.853268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a5c29-1f7e-45e1-b8cb-20a8807fd44b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:50.854852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a5c29-1f7e-45e1-b8cb-20a8807fd44b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-9b732c5b-8961-437d-9d5a-465cde7162bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:50.867475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:50.868420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:50.870217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:50.870217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:50.870217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:50.870217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:50.870217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:50.870217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:50.870217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:50.870217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:50.870805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 417/854] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:50.876942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a5c29-1f7e-45e1-b8cb-20a8807fd44b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.877208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 438/855] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:50.878759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b732c5b-8961-437d-9d5a-465cde7162bb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:50.986410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:50.996347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b732c5b-8961-437d-9d5a-465cde7162bb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:51.006133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a5c29-1f7e-45e1-b8cb-20a8807fd44b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:51.032064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5920-8ae9-47e8-ab4d-7930b5823f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:51.032858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5920-8ae9-47e8-ab4d-7930b5823f04 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:51.033214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5920-8ae9-47e8-ab4d-7930b5823f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:51.033553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5920-8ae9-47e8-ab4d-7930b5823f04 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:51.034401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb5920-8ae9-47e8-ab4d-7930b5823f04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:51.034778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb5920-8ae9-47e8-ab4d-7930b5823f04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:51.036330 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb5920-8ae9-47e8-ab4d-7930b5823f04 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:51.054008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 439/856] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:51.056309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5920-8ae9-47e8-ab4d-7930b5823f04 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:51.059538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdbfd4-5afc-44f4-91be-7a7da93ad1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:51.060485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdbfd4-5afc-44f4-91be-7a7da93ad1ea None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:51.060863 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdbfd4-5afc-44f4-91be-7a7da93ad1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:51.061931 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdbfd4-5afc-44f4-91be-7a7da93ad1ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:51.069050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdbfd4-5afc-44f4-91be-7a7da93ad1ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:51.070624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdbfd4-5afc-44f4-91be-7a7da93ad1ea None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-f0fdbfd4-5afc-44f4-91be-7a7da93ad1ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:51.086449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:51.088444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:51.089603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:51.089603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:51.089603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:51.089603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:51.089603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:51.089603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:51.089603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:51.089603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:51.089603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 17:17:51.089603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:51.095888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 418/857] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:17:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:51.096848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdbfd4-5afc-44f4-91be-7a7da93ad1ea None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:51.112442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:51.175109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5920-8ae9-47e8-ab4d-7930b5823f04 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:51.202531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdbfd4-5afc-44f4-91be-7a7da93ad1ea None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:51.212433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ef2d2-0cd3-4523-95e0-4ecb1ea03cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:51.213422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ef2d2-0cd3-4523-95e0-4ecb1ea03cbc None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:51.213853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ef2d2-0cd3-4523-95e0-4ecb1ea03cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:51.214279 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ef2d2-0cd3-4523-95e0-4ecb1ea03cbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:51.215231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ef2d2-0cd3-4523-95e0-4ecb1ea03cbc None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=9f9b0c02f87340998d1736f2062b7164) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:51.215686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ef2d2-0cd3-4523-95e0-4ecb1ea03cbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:51.217305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ef2d2-0cd3-4523-95e0-4ecb1ea03cbc None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:51.232223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 440/858] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:51 2022] GET /identity/v3/role_assignments?user.id=9f9b0c02f87340998d1736f2062b7164&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:51.240227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2e301-34df-436b-8f5b-828ad195b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:51.241074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2e301-34df-436b-8f5b-828ad195b22b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:51.241455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2e301-34df-436b-8f5b-828ad195b22b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:51.241829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2e301-34df-436b-8f5b-828ad195b22b None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:51.242813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2e301-34df-436b-8f5b-828ad195b22b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:51.243227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2e301-34df-436b-8f5b-828ad195b22b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:51.244911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2e301-34df-436b-8f5b-828ad195b22b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:51.266923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 419/859] 10.222.0.77 () {56 vars in 1135 bytes} [Thu Jun 16 17:17:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:51.273215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ef2d2-0cd3-4523-95e0-4ecb1ea03cbc None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:51.292518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:51.387175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ef2d2-0cd3-4523-95e0-4ecb1ea03cbc None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:51.425251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acb11e-f13d-46b0-b473-691c2fe870e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:51.425829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acb11e-f13d-46b0-b473-691c2fe870e2 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:51.426112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acb11e-f13d-46b0-b473-691c2fe870e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:51.426381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acb11e-f13d-46b0-b473-691c2fe870e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:51.502902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acb11e-f13d-46b0-b473-691c2fe870e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:51.504392 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acb11e-f13d-46b0-b473-691c2fe870e2 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:51.522815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:51.631081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 441/860] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:17:51.636965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2e301-34df-436b-8f5b-828ad195b22b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:51.716114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:51.747392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2e301-34df-436b-8f5b-828ad195b22b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:51.783321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c090c-67ce-4e96-b871-f0afd0264e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:51.784208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c090c-67ce-4e96-b871-f0afd0264e47 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:51.784489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c090c-67ce-4e96-b871-f0afd0264e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:51.784811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c090c-67ce-4e96-b871-f0afd0264e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:51.795704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c090c-67ce-4e96-b871-f0afd0264e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:51.797177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c090c-67ce-4e96-b871-f0afd0264e47 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d43c090c-67ce-4e96-b871-f0afd0264e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:51.823458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:51.824705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:51.826078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:51.826078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:51.826078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:51.826078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:51.826078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 420/861] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:51.830357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acb11e-f13d-46b0-b473-691c2fe870e2 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:51.916471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e502a-7dbe-4e85-a744-576588ba8459 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:51.916824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e502a-7dbe-4e85-a744-576588ba8459 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:51.917046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e502a-7dbe-4e85-a744-576588ba8459 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:51.918727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 421/862] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:51.924237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208c62-2e53-4faf-a998-dffe8e09247e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:51.924531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208c62-2e53-4faf-a998-dffe8e09247e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:51.924814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208c62-2e53-4faf-a998-dffe8e09247e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:51.943007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-78208c62-2e53-4faf-a998-dffe8e09247e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:51.944224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-78208c62-2e53-4faf-a998-dffe8e09247e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:51.952740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acb11e-f13d-46b0-b473-691c2fe870e2 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:51.970675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:51.992095 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f321-5c36-4124-a98b-14adf3088f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:51.992795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f321-5c36-4124-a98b-14adf3088f8c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:51.993077 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f321-5c36-4124-a98b-14adf3088f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:51.993351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f321-5c36-4124-a98b-14adf3088f8c None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:51.994163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f321-5c36-4124-a98b-14adf3088f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:51.994496 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f321-5c36-4124-a98b-14adf3088f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:51.996099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f321-5c36-4124-a98b-14adf3088f8c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:52.011812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 442/863] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:52.017751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f321-5c36-4124-a98b-14adf3088f8c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:52.040162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 422/864] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:17:52.062173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208c62-2e53-4faf-a998-dffe8e09247e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:52.131198 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:52.148230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f321-5c36-4124-a98b-14adf3088f8c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:52.194738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fc77f-d679-4390-bd1d-67ed00e60cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:52.195940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc77f-d679-4390-bd1d-67ed00e60cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.196484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc77f-d679-4390-bd1d-67ed00e60cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.196643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208c62-2e53-4faf-a998-dffe8e09247e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:52.197188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc77f-d679-4390-bd1d-67ed00e60cf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.205457 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fc77f-d679-4390-bd1d-67ed00e60cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:52.207198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fc77f-d679-4390-bd1d-67ed00e60cf2 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b32fc77f-d679-4390-bd1d-67ed00e60cf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:52.224185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:52.225089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:52.225994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:52.225994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:52.225994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:52.225994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:52.225994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:52.225994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:52.225994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:52.225994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:52.228698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 443/865] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:52.233982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fc77f-d679-4390-bd1d-67ed00e60cf2 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:52.244871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3266e3-8131-4633-9da4-9b217d5f4c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:52.246056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3266e3-8131-4633-9da4-9b217d5f4c67 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.246614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3266e3-8131-4633-9da4-9b217d5f4c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.247113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3266e3-8131-4633-9da4-9b217d5f4c67 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.248059 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3266e3-8131-4633-9da4-9b217d5f4c67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:52.249741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3266e3-8131-4633-9da4-9b217d5f4c67 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:52.277758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:52.343955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 423/866] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:17:52 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:52.371468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fc77f-d679-4390-bd1d-67ed00e60cf2 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:52.421521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdebcd-9ec7-4f96-ab95-eee903487a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:52.422209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdebcd-9ec7-4f96-ab95-eee903487a0e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.422495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdebcd-9ec7-4f96-ab95-eee903487a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.422774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdebcd-9ec7-4f96-ab95-eee903487a0e None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.423701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdebcd-9ec7-4f96-ab95-eee903487a0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:52.424022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdebcd-9ec7-4f96-ab95-eee903487a0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:52.425514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdebcd-9ec7-4f96-ab95-eee903487a0e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:52.440511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 444/867] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:52.446567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3266e3-8131-4633-9da4-9b217d5f4c67 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:52.565491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d79e2-5f36-482f-a2ab-0c678e46f0c0 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.565677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d79e2-5f36-482f-a2ab-0c678e46f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.565965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d79e2-5f36-482f-a2ab-0c678e46f0c0 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.567447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 445/868] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:52.577148 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659327b4-c49e-42a9-a962-4f922bc714e8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.577148 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659327b4-c49e-42a9-a962-4f922bc714e8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.578082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659327b4-c49e-42a9-a962-4f922bc714e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.583890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3266e3-8131-4633-9da4-9b217d5f4c67 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:52.598590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-659327b4-c49e-42a9-a962-4f922bc714e8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:52.599909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-659327b4-c49e-42a9-a962-4f922bc714e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:52.601936 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:52.629227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f0d5f-e550-4166-a0b5-e858670e0fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:52.629894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f0d5f-e550-4166-a0b5-e858670e0fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.630178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f0d5f-e550-4166-a0b5-e858670e0fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.630453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f0d5f-e550-4166-a0b5-e858670e0fd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.631277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f0d5f-e550-4166-a0b5-e858670e0fd0 None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=e3c319430309419c895a0dc3c90ce80e) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:52.631592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f0d5f-e550-4166-a0b5-e858670e0fd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:52.633090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f0d5f-e550-4166-a0b5-e858670e0fd0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:52.641729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 424/869] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:52 2022] GET /identity/v3/role_assignments?user.id=e3c319430309419c895a0dc3c90ce80e&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:52.686750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 446/870] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:52.709193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f0d5f-e550-4166-a0b5-e858670e0fd0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:52.824628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f0d5f-e550-4166-a0b5-e858670e0fd0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:52.867601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfe21b-34d7-4ba0-8113-bb5f24c80c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:52.869084 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfe21b-34d7-4ba0-8113-bb5f24c80c00 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:52.869917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfe21b-34d7-4ba0-8113-bb5f24c80c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:52.870199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfe21b-34d7-4ba0-8113-bb5f24c80c00 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:52.870863 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfe21b-34d7-4ba0-8113-bb5f24c80c00 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:52.872308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfe21b-34d7-4ba0-8113-bb5f24c80c00 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-85bfe21b-34d7-4ba0-8113-bb5f24c80c00 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:52.886111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:52.887387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:52.888695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 425/871] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Jun 16 17:17:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:52.895467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659327b4-c49e-42a9-a962-4f922bc714e8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:52.921077 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:53.005212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659327b4-c49e-42a9-a962-4f922bc714e8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:53.045861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18f79f-df47-400e-bafb-3dedefa782e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:53.046897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18f79f-df47-400e-bafb-3dedefa782e3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:53.047377 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18f79f-df47-400e-bafb-3dedefa782e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:53.047866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18f79f-df47-400e-bafb-3dedefa782e3 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:53.048781 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18f79f-df47-400e-bafb-3dedefa782e3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:53.049309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18f79f-df47-400e-bafb-3dedefa782e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:53.050851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18f79f-df47-400e-bafb-3dedefa782e3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:53.056545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 447/872] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:17:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:53.062514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfe21b-34d7-4ba0-8113-bb5f24c80c00 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:53.107964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:53.174722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfe21b-34d7-4ba0-8113-bb5f24c80c00 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:53.210112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a264ba-afe8-4230-8996-405d25bede1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:53.210787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a264ba-afe8-4230-8996-405d25bede1b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:53.211066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a264ba-afe8-4230-8996-405d25bede1b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:53.211340 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a264ba-afe8-4230-8996-405d25bede1b None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:53.212037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a264ba-afe8-4230-8996-405d25bede1b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:53.212908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a264ba-afe8-4230-8996-405d25bede1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:53.214284 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a264ba-afe8-4230-8996-405d25bede1b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:53.219461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 426/873] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:17:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:53.699323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc02dc-a904-4d39-b913-7e122ee4772a None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:53.699792 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc02dc-a904-4d39-b913-7e122ee4772a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:53.700219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc02dc-a904-4d39-b913-7e122ee4772a None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:53.701990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 448/874] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:53.707355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f24a-8781-4354-9417-0e9e30bd5232 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:53.707756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f24a-8781-4354-9417-0e9e30bd5232 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:53.708168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6f24a-8781-4354-9417-0e9e30bd5232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:53.725733 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fab6f24a-8781-4354-9417-0e9e30bd5232 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:53.726974 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fab6f24a-8781-4354-9417-0e9e30bd5232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:53.801927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 427/875] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:53.821290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc02dc-a904-4d39-b913-7e122ee4772a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:53.913288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:53.934022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc02dc-a904-4d39-b913-7e122ee4772a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:53.971562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbfbb1-6679-4560-b0bf-349032a4e264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:53.973248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbfbb1-6679-4560-b0bf-349032a4e264 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:53.973745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbfbb1-6679-4560-b0bf-349032a4e264 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:53.974253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbfbb1-6679-4560-b0bf-349032a4e264 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:53.986525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbfbb1-6679-4560-b0bf-349032a4e264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-13bbfbb1-6679-4560-b0bf-349032a4e264 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:53.995574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:53.996581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:17:53.997397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:54.004238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 449/876] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Jun 16 17:17:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:54.006668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6f24a-8781-4354-9417-0e9e30bd5232 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:54.047960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:54.116527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6f24a-8781-4354-9417-0e9e30bd5232 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:54.152458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb692d-dd4e-4730-9bc2-127e90a13fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:54.153131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb692d-dd4e-4730-9bc2-127e90a13fed None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:54.153408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb692d-dd4e-4730-9bc2-127e90a13fed None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:54.153678 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb692d-dd4e-4730-9bc2-127e90a13fed None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:54.154412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb692d-dd4e-4730-9bc2-127e90a13fed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:54.154713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb692d-dd4e-4730-9bc2-127e90a13fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:54.156145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb692d-dd4e-4730-9bc2-127e90a13fed None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:54.164773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 428/877] 10.222.0.77 () {56 vars in 1115 bytes} [Thu Jun 16 17:17:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:54.171025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbfbb1-6679-4560-b0bf-349032a4e264 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:54.278507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbfbb1-6679-4560-b0bf-349032a4e264 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:54.313038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a237-e2b3-4d90-a817-111847cad3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:54.313842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a237-e2b3-4d90-a817-111847cad3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:54.314119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a237-e2b3-4d90-a817-111847cad3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:54.314391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a237-e2b3-4d90-a817-111847cad3c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:54.326143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a237-e2b3-4d90-a817-111847cad3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:54.327597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a237-e2b3-4d90-a817-111847cad3c3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:54.330183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-7cb7a237-e2b3-4d90-a817-111847cad3c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:54.345798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:54.346720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:54.348214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:54.348214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:54.348214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:54.348214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:54.348214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 450/878] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:54.354464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb692d-dd4e-4730-9bc2-127e90a13fed None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:54.464112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:54.470151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb692d-dd4e-4730-9bc2-127e90a13fed None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:54.505103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464083e-5fd5-4583-aaea-c32c8f80b7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:54.505829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464083e-5fd5-4583-aaea-c32c8f80b7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:54.506127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464083e-5fd5-4583-aaea-c32c8f80b7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:54.506406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464083e-5fd5-4583-aaea-c32c8f80b7e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:54.507206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464083e-5fd5-4583-aaea-c32c8f80b7e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:54.507516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464083e-5fd5-4583-aaea-c32c8f80b7e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:54.509771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464083e-5fd5-4583-aaea-c32c8f80b7e5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:54.523518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 429/879] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:54.533231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a237-e2b3-4d90-a817-111847cad3c3 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:54.614181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb09811-f1e0-4674-934b-247a94788b69 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:54.614503 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb09811-f1e0-4674-934b-247a94788b69 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:54.614748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb09811-f1e0-4674-934b-247a94788b69 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:54.616977 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 430/880] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:54.621498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42208b89-8408-48cb-a84c-9ad2dd66a96c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:54.621730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42208b89-8408-48cb-a84c-9ad2dd66a96c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:54.621999 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42208b89-8408-48cb-a84c-9ad2dd66a96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:54.641047 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-42208b89-8408-48cb-a84c-9ad2dd66a96c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:54.642554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-42208b89-8408-48cb-a84c-9ad2dd66a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:54.670289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a237-e2b3-4d90-a817-111847cad3c3 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:54.706522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff9de6-3d9f-42d6-93e1-43152e5b531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:54.707348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9de6-3d9f-42d6-93e1-43152e5b531d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:54.707634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9de6-3d9f-42d6-93e1-43152e5b531d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:54.707908 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9de6-3d9f-42d6-93e1-43152e5b531d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:54.716569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff9de6-3d9f-42d6-93e1-43152e5b531d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:54.717935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff9de6-3d9f-42d6-93e1-43152e5b531d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-cbff9de6-3d9f-42d6-93e1-43152e5b531d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:17:54.732788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:54.733754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:54.734718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:54.734718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:54.734718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:17:54.734718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:17:54.734718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:17:54.734718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:17:54.734718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:17:54.734718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:17:54.734718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:17:54.734718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:54.738164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 431/881] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:17:54.740367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 451/882] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Jun 16 17:17:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:54.741487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42208b89-8408-48cb-a84c-9ad2dd66a96c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:54.762220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff9de6-3d9f-42d6-93e1-43152e5b531d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:54.828480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:54.859119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:54.876619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff9de6-3d9f-42d6-93e1-43152e5b531d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:54.880640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42208b89-8408-48cb-a84c-9ad2dd66a96c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:54.920231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fdfd-0235-46d5-87a5-58c61530a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:54.920946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fdfd-0235-46d5-87a5-58c61530a722 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:54.921230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fdfd-0235-46d5-87a5-58c61530a722 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:54.921506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fdfd-0235-46d5-87a5-58c61530a722 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:54.922362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371fdfd-0235-46d5-87a5-58c61530a722 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:54.922647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371fdfd-0235-46d5-87a5-58c61530a722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:54.924357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371fdfd-0235-46d5-87a5-58c61530a722 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:54.925150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f67395-9f43-4c48-a721-718175bee2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:54.926456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f67395-9f43-4c48-a721-718175bee2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:54.927514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f67395-9f43-4c48-a721-718175bee2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:54.927967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f67395-9f43-4c48-a721-718175bee2c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:54.929972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f67395-9f43-4c48-a721-718175bee2c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:54.932843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f67395-9f43-4c48-a721-718175bee2c8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-80f67395-9f43-4c48-a721-718175bee2c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:54.948479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:54.949585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:17:54.950414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:54.951839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 432/883] 10.222.0.77 () {56 vars in 1149 bytes} [Thu Jun 16 17:17:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:54.952351 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fdfd-0235-46d5-87a5-58c61530a722 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:54.953818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 452/884] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:17:54.961065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f67395-9f43-4c48-a721-718175bee2c8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.065597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fdfd-0235-46d5-87a5-58c61530a722 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:55.075277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f67395-9f43-4c48-a721-718175bee2c8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:55.098565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:55.105133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16374b5-1254-4091-bb45-16a66ef68001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:55.105799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16374b5-1254-4091-bb45-16a66ef68001 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.106084 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16374b5-1254-4091-bb45-16a66ef68001 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.106363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16374b5-1254-4091-bb45-16a66ef68001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.115519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b64b22-4229-4175-b599-44c9af7a5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:55.116457 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b64b22-4229-4175-b599-44c9af7a5d0d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.116952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b64b22-4229-4175-b599-44c9af7a5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.117745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b64b22-4229-4175-b599-44c9af7a5d0d None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.119012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b64b22-4229-4175-b599-44c9af7a5d0d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:55.119545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b64b22-4229-4175-b599-44c9af7a5d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:55.121415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b64b22-4229-4175-b599-44c9af7a5d0d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:55.121720 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:55.132122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 453/885] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:55.132122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c176-965c-4c26-8487-ac115b2153e9 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.132122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c176-965c-4c26-8487-ac115b2153e9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.132122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c176-965c-4c26-8487-ac115b2153e9 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.133437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 454/886] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:55.135092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018c176-965c-4c26-8487-ac115b2153e9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.183462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16374b5-1254-4091-bb45-16a66ef68001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:55.184956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16374b5-1254-4091-bb45-16a66ef68001 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:55.249710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018c176-965c-4c26-8487-ac115b2153e9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:55.289195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf7dca-9da4-4cf0-86ef-212ac4e96eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:55.290039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf7dca-9da4-4cf0-86ef-212ac4e96eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.290727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf7dca-9da4-4cf0-86ef-212ac4e96eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.291418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf7dca-9da4-4cf0-86ef-212ac4e96eb5 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.292267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf7dca-9da4-4cf0-86ef-212ac4e96eb5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:55.292684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf7dca-9da4-4cf0-86ef-212ac4e96eb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:55.298313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 433/887] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:17:54 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:17:55.298459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf7dca-9da4-4cf0-86ef-212ac4e96eb5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:55.298568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f9aa-6304-4f5b-873c-63443122a0a3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.298568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f9aa-6304-4f5b-873c-63443122a0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.298568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f9aa-6304-4f5b-873c-63443122a0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.308369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 455/888] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:55.308369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf7dca-9da4-4cf0-86ef-212ac4e96eb5 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.314877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3216f9aa-6304-4f5b-873c-63443122a0a3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:55.316239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3216f9aa-6304-4f5b-873c-63443122a0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:55.358071 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:55.362089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:55.392567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 434/889] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:55.392567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216f9aa-6304-4f5b-873c-63443122a0a3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.424752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf7dca-9da4-4cf0-86ef-212ac4e96eb5 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:55.463039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f50c-4ee2-47d3-a197-20e7e33cc155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:55.463836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f50c-4ee2-47d3-a197-20e7e33cc155 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.464158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f50c-4ee2-47d3-a197-20e7e33cc155 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.464429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f50c-4ee2-47d3-a197-20e7e33cc155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.476267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011f50c-4ee2-47d3-a197-20e7e33cc155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:55.477811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011f50c-4ee2-47d3-a197-20e7e33cc155 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-6011f50c-4ee2-47d3-a197-20e7e33cc155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:55.498224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:55.499364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:55.500332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:55.500332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:55.500332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:55.500332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:55.500332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 456/890] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:55.500716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f50c-4ee2-47d3-a197-20e7e33cc155 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.508751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216f9aa-6304-4f5b-873c-63443122a0a3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:55.547764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead5316-6925-4354-866d-33c23e9b8aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:55.548485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead5316-6925-4354-866d-33c23e9b8aba None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.548768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead5316-6925-4354-866d-33c23e9b8aba None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.549045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead5316-6925-4354-866d-33c23e9b8aba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.549845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead5316-6925-4354-866d-33c23e9b8aba None admin] RBAC: Adding query filter params (interface=public, service_id=c75863f6f75c46de83b3237db8ad19e3, region_id=RegionOne) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:55.550156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead5316-6925-4354-866d-33c23e9b8aba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:55.551525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead5316-6925-4354-866d-33c23e9b8aba None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:55.557100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 435/891] 10.222.0.77 () {56 vars in 1251 bytes} [Thu Jun 16 17:17:55 2022] GET /identity/v3/endpoints?service_id=c75863f6f75c46de83b3237db8ad19e3&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:55.557866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead5316-6925-4354-866d-33c23e9b8aba None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.597478 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:55.609436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:55.612433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f50c-4ee2-47d3-a197-20e7e33cc155 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:55.646448 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73596ae-eabb-4000-89be-ee00fbeb1711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:55.647286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73596ae-eabb-4000-89be-ee00fbeb1711 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.647592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73596ae-eabb-4000-89be-ee00fbeb1711 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.647909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73596ae-eabb-4000-89be-ee00fbeb1711 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.648602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73596ae-eabb-4000-89be-ee00fbeb1711 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:55.651078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73596ae-eabb-4000-89be-ee00fbeb1711 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:55.656785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead5316-6925-4354-866d-33c23e9b8aba None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-f73596ae-eabb-4000-89be-ee00fbeb1711 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:55.663324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:55.664385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:55.665361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 457/892] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:17:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:55.666477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb46da-32eb-4a1c-981e-142046ba5d01 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.666774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb46da-32eb-4a1c-981e-142046ba5d01 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.667059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb46da-32eb-4a1c-981e-142046ba5d01 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.672343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 458/893] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:55.672343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb46da-32eb-4a1c-981e-142046ba5d01 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.695356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea016f-7906-44b5-97d5-a6236062130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:55.696190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea016f-7906-44b5-97d5-a6236062130b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.697002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea016f-7906-44b5-97d5-a6236062130b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.697392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea016f-7906-44b5-97d5-a6236062130b None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.698307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea016f-7906-44b5-97d5-a6236062130b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:55.698614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea016f-7906-44b5-97d5-a6236062130b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:55.699980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea016f-7906-44b5-97d5-a6236062130b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:55.711116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 436/894] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:55.711899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea016f-7906-44b5-97d5-a6236062130b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.781054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb46da-32eb-4a1c-981e-142046ba5d01 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:55.810328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:55.814134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea016f-7906-44b5-97d5-a6236062130b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:55.814922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349666e-9cac-4958-b080-f19451cd0487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:55.815596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349666e-9cac-4958-b080-f19451cd0487 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.815880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349666e-9cac-4958-b080-f19451cd0487 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.816193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349666e-9cac-4958-b080-f19451cd0487 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.816872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349666e-9cac-4958-b080-f19451cd0487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:55.818244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349666e-9cac-4958-b080-f19451cd0487 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:55.824697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 459/895] 10.222.0.77 () {56 vars in 1087 bytes} [Thu Jun 16 17:17:55 2022] GET /identity/v3/services => generated 1011 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:17:55.825911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3e52-83e8-45ed-8256-44d4f3476c19 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.826208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3e52-83e8-45ed-8256-44d4f3476c19 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.826493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3e52-83e8-45ed-8256-44d4f3476c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.845789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-119c3e52-83e8-45ed-8256-44d4f3476c19 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:55.845789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-119c3e52-83e8-45ed-8256-44d4f3476c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:55.854394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d848c77-14b7-4329-8cfc-48c7643299fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:55.855100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d848c77-14b7-4329-8cfc-48c7643299fe None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:55.855380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d848c77-14b7-4329-8cfc-48c7643299fe None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:55.855650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d848c77-14b7-4329-8cfc-48c7643299fe None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:55.856405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d848c77-14b7-4329-8cfc-48c7643299fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:55.856714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d848c77-14b7-4329-8cfc-48c7643299fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:55.858213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d848c77-14b7-4329-8cfc-48c7643299fe None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:55.863310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 437/896] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Jun 16 17:17:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:55.869365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d848c77-14b7-4329-8cfc-48c7643299fe None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.883635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:55.939684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 460/897] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:55.941364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c3e52-83e8-45ed-8256-44d4f3476c19 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:55.998490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d848c77-14b7-4329-8cfc-48c7643299fe None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:56.039426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4670-d26f-47ba-a61d-150cf044b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:56.040956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4670-d26f-47ba-a61d-150cf044b73a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:56.041403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4670-d26f-47ba-a61d-150cf044b73a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:56.041686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4670-d26f-47ba-a61d-150cf044b73a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:56.048916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb4670-d26f-47ba-a61d-150cf044b73a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:56.050455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb4670-d26f-47ba-a61d-150cf044b73a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:56.058725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c3e52-83e8-45ed-8256-44d4f3476c19 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d3eb4670-d26f-47ba-a61d-150cf044b73a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:17:56.065289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:56.066573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:56.067508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:17:56.067508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:17:56.067508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:17:56.067508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:17:56.067508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:17:56.067508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:17:56.067508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:17:56.067508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:56.067508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 438/898] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:56.067980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4670-d26f-47ba-a61d-150cf044b73a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:56.096060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:56.098381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ea662-f191-400b-a7b3-757847f52897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:56.099052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ea662-f191-400b-a7b3-757847f52897 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:56.099343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ea662-f191-400b-a7b3-757847f52897 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:56.099619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ea662-f191-400b-a7b3-757847f52897 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:56.100355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ea662-f191-400b-a7b3-757847f52897 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:56.100663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ea662-f191-400b-a7b3-757847f52897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:56.102028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ea662-f191-400b-a7b3-757847f52897 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:56.107859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 461/899] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Jun 16 17:17:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:56.108177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ea662-f191-400b-a7b3-757847f52897 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:56.148358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:56.194320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4670-d26f-47ba-a61d-150cf044b73a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:56.242407 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ea662-f191-400b-a7b3-757847f52897 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:56.244491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1898d7-98a4-4fb2-92dd-f4f639568b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:56.245368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1898d7-98a4-4fb2-92dd-f4f639568b8f None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:56.245655 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1898d7-98a4-4fb2-92dd-f4f639568b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:56.245935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1898d7-98a4-4fb2-92dd-f4f639568b8f None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:56.247590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1898d7-98a4-4fb2-92dd-f4f639568b8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:56.249028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1898d7-98a4-4fb2-92dd-f4f639568b8f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:56.283362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cc2f0-a87a-4a6b-ae24-bda2a52c2d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:56.284391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cc2f0-a87a-4a6b-ae24-bda2a52c2d1d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:56.284678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cc2f0-a87a-4a6b-ae24-bda2a52c2d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:56.284951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cc2f0-a87a-4a6b-ae24-bda2a52c2d1d None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:56.285730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cc2f0-a87a-4a6b-ae24-bda2a52c2d1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:56.286102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cc2f0-a87a-4a6b-ae24-bda2a52c2d1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:56.287891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cc2f0-a87a-4a6b-ae24-bda2a52c2d1d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:56.302374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 462/900] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:17:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:56.308225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cc2f0-a87a-4a6b-ae24-bda2a52c2d1d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:56.375446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 439/901] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:17:56 2022] POST /identity/v3/services => generated 269 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:56.408803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:56.430875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cc2f0-a87a-4a6b-ae24-bda2a52c2d1d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:56.478933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433859a-fc61-48fb-91b0-fbd9c5df3bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:56.479612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433859a-fc61-48fb-91b0-fbd9c5df3bcb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:56.479893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433859a-fc61-48fb-91b0-fbd9c5df3bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:56.480204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433859a-fc61-48fb-91b0-fbd9c5df3bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:56.481047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433859a-fc61-48fb-91b0-fbd9c5df3bcb None admin] RBAC: Adding query filter params (role.id=288469399b864e5fa238342d9301217b, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=9f9b0c02f87340998d1736f2062b7164) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:56.481360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433859a-fc61-48fb-91b0-fbd9c5df3bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:56.482892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433859a-fc61-48fb-91b0-fbd9c5df3bcb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:56.489981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 463/902] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:17:56 2022] GET /identity/v3/role_assignments?user.id=9f9b0c02f87340998d1736f2062b7164&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=288469399b864e5fa238342d9301217b => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:58.187179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2bbe-448d-4212-9dd2-37d3ea97e7c1 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.187179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2bbe-448d-4212-9dd2-37d3ea97e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.187179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2bbe-448d-4212-9dd2-37d3ea97e7c1 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.188431 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 440/903] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:58.193981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51467cc1-ae55-4b49-81ee-2fb7a0c7799e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.194786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51467cc1-ae55-4b49-81ee-2fb7a0c7799e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.195268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51467cc1-ae55-4b49-81ee-2fb7a0c7799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.213290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-51467cc1-ae55-4b49-81ee-2fb7a0c7799e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:58.214859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-51467cc1-ae55-4b49-81ee-2fb7a0c7799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:58.292228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 464/904] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:58.310601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2bbe-448d-4212-9dd2-37d3ea97e7c1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:58.403511 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:58.427330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2bbe-448d-4212-9dd2-37d3ea97e7c1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:58.466102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d5270-6e4b-4734-ad98-3fda19a6cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:58.467508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d5270-6e4b-4734-ad98-3fda19a6cd66 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.468013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d5270-6e4b-4734-ad98-3fda19a6cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.468516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d5270-6e4b-4734-ad98-3fda19a6cd66 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.469370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d5270-6e4b-4734-ad98-3fda19a6cd66 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:58.470965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d5270-6e4b-4734-ad98-3fda19a6cd66 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:58.486130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11788-4f6c-48fe-98a1-39996f1aafcf None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.486440 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11788-4f6c-48fe-98a1-39996f1aafcf None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.488240 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11788-4f6c-48fe-98a1-39996f1aafcf None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-3f2d5270-6e4b-4734-ad98-3fda19a6cd66 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:58.488352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:58.489276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:58.490124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 441/905] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:58.491562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 465/906] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:58.495224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1df1e-fbed-4090-b55b-1ea3cbc27391 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.495517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1df1e-fbed-4090-b55b-1ea3cbc27391 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.495796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1df1e-fbed-4090-b55b-1ea3cbc27391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.499703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed11788-4f6c-48fe-98a1-39996f1aafcf None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:58.520323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-80e1df1e-fbed-4090-b55b-1ea3cbc27391 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:58.521844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-80e1df1e-fbed-4090-b55b-1ea3cbc27391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:58.587909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:58.600957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 442/907] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:58.624956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed11788-4f6c-48fe-98a1-39996f1aafcf None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:58.628855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1df1e-fbed-4090-b55b-1ea3cbc27391 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:58.663191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95515ef-ffa5-4e19-8797-0f87a0dbe470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:58.663859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95515ef-ffa5-4e19-8797-0f87a0dbe470 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.664259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95515ef-ffa5-4e19-8797-0f87a0dbe470 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.664472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95515ef-ffa5-4e19-8797-0f87a0dbe470 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.665715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95515ef-ffa5-4e19-8797-0f87a0dbe470 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:58.666257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95515ef-ffa5-4e19-8797-0f87a0dbe470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:58.667824 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95515ef-ffa5-4e19-8797-0f87a0dbe470 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:58.677572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 466/908] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:58.679117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95515ef-ffa5-4e19-8797-0f87a0dbe470 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:58.724478 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:58.750056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1df1e-fbed-4090-b55b-1ea3cbc27391 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:58.786020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fa4ba-6f21-4f96-ae5c-f78f24d3af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:58.786690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fa4ba-6f21-4f96-ae5c-f78f24d3af28 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.786868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95515ef-ffa5-4e19-8797-0f87a0dbe470 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:58.786995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fa4ba-6f21-4f96-ae5c-f78f24d3af28 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.787274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fa4ba-6f21-4f96-ae5c-f78f24d3af28 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.787997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fa4ba-6f21-4f96-ae5c-f78f24d3af28 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:58.789419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fa4ba-6f21-4f96-ae5c-f78f24d3af28 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:58.821123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528803b4-4277-4ef3-ba8c-c421179fbed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:58.822041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528803b4-4277-4ef3-ba8c-c421179fbed2 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.822361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528803b4-4277-4ef3-ba8c-c421179fbed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.822597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528803b4-4277-4ef3-ba8c-c421179fbed2 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.823294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528803b4-4277-4ef3-ba8c-c421179fbed2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:58.823603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528803b4-4277-4ef3-ba8c-c421179fbed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:58.824982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528803b4-4277-4ef3-ba8c-c421179fbed2 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:58.826930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:58.830060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 467/909] 10.222.0.77 () {56 vars in 1114 bytes} [Thu Jun 16 17:17:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:58.831245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554201c-a487-4096-9e39-778477887e47 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.831531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554201c-a487-4096-9e39-778477887e47 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.831808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554201c-a487-4096-9e39-778477887e47 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.833035 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 468/910] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:58.834095 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fefe32-69ff-4774-8bec-eb6d041f29d0 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.834376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fefe32-69ff-4774-8bec-eb6d041f29d0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.834654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fefe32-69ff-4774-8bec-eb6d041f29d0 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.835839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 469/911] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:17:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:17:58.836544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fefe32-69ff-4774-8bec-eb6d041f29d0 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:58.893922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 443/912] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:17:58 2022] POST /identity/v3/services => generated 241 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:58.895962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eefa50-c25c-4e61-9936-35523ddd469d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:58.896497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eefa50-c25c-4e61-9936-35523ddd469d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:58.896980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eefa50-c25c-4e61-9936-35523ddd469d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:58.927469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-71eefa50-c25c-4e61-9936-35523ddd469d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:58.928914 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-71eefa50-c25c-4e61-9936-35523ddd469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:58.955651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fefe32-69ff-4774-8bec-eb6d041f29d0 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:59.000441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec697fe-d91c-4ae8-9603-b33a2475ff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:59.001129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec697fe-d91c-4ae8-9603-b33a2475ff82 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.001506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec697fe-d91c-4ae8-9603-b33a2475ff82 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.001856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec697fe-d91c-4ae8-9603-b33a2475ff82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.002751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec697fe-d91c-4ae8-9603-b33a2475ff82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:59.004245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec697fe-d91c-4ae8-9603-b33a2475ff82 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:59.023095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 444/913] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:59.023095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee97c8c-0ffe-409a-8427-86901533270b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.023095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee97c8c-0ffe-409a-8427-86901533270b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.023095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee97c8c-0ffe-409a-8427-86901533270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.042012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fee97c8c-0ffe-409a-8427-86901533270b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:17:59.043485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fee97c8c-0ffe-409a-8427-86901533270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:17:59.106985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:59.114231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 445/914] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:17:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:17:59.115090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee97c8c-0ffe-409a-8427-86901533270b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.144112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 470/915] 10.222.0.77 () {60 vars in 1144 bytes} [Thu Jun 16 17:17:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:17:59.144112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec697fe-d91c-4ae8-9603-b33a2475ff82 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.229023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:59.248369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee97c8c-0ffe-409a-8427-86901533270b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:59.298617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c353b3-de39-40e1-8123-14b7bef6b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:59.298617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c353b3-de39-40e1-8123-14b7bef6b73a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.298617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c353b3-de39-40e1-8123-14b7bef6b73a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.298617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c353b3-de39-40e1-8123-14b7bef6b73a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.299050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c353b3-de39-40e1-8123-14b7bef6b73a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:59.299050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c353b3-de39-40e1-8123-14b7bef6b73a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:59.301031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec697fe-d91c-4ae8-9603-b33a2475ff82 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-e9c353b3-de39-40e1-8123-14b7bef6b73a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:59.315177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:59.316208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:17:59.317290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:17:59.318241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 446/916] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:59.325017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c353b3-de39-40e1-8123-14b7bef6b73a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.350039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1553c-0102-41fe-99a8-70c4f10fb298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:59.350903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1553c-0102-41fe-99a8-70c4f10fb298 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.351192 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1553c-0102-41fe-99a8-70c4f10fb298 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.351472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1553c-0102-41fe-99a8-70c4f10fb298 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.366839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1553c-0102-41fe-99a8-70c4f10fb298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-f1c1553c-0102-41fe-99a8-70c4f10fb298 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:17:59.376015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:59.377143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:59.377993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 471/917] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:59.383460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1553c-0102-41fe-99a8-70c4f10fb298 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.412692 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:59.490970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c353b3-de39-40e1-8123-14b7bef6b73a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:59.513157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1553c-0102-41fe-99a8-70c4f10fb298 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:59.531562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:59.538210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af442d-3a32-49b9-b53a-c32ff901ca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:59.539181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af442d-3a32-49b9-b53a-c32ff901ca89 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.540784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af442d-3a32-49b9-b53a-c32ff901ca89 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.541569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af442d-3a32-49b9-b53a-c32ff901ca89 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.542899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af442d-3a32-49b9-b53a-c32ff901ca89 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:59.543568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af442d-3a32-49b9-b53a-c32ff901ca89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:59.545821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af442d-3a32-49b9-b53a-c32ff901ca89 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:59.557149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 447/918] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:59.562855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af442d-3a32-49b9-b53a-c32ff901ca89 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.565099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79ba2e-9739-437f-8590-7c5bcc9921e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:59.565779 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79ba2e-9739-437f-8590-7c5bcc9921e8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.566061 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79ba2e-9739-437f-8590-7c5bcc9921e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.566362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79ba2e-9739-437f-8590-7c5bcc9921e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.567077 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79ba2e-9739-437f-8590-7c5bcc9921e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:59.567380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79ba2e-9739-437f-8590-7c5bcc9921e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:59.568790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79ba2e-9739-437f-8590-7c5bcc9921e8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:59.590877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 472/919] 10.222.0.77 () {56 vars in 1115 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:17:59.592427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79ba2e-9739-437f-8590-7c5bcc9921e8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.693624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af442d-3a32-49b9-b53a-c32ff901ca89 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:59.702738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79ba2e-9739-437f-8590-7c5bcc9921e8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:59.721232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:59.739816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337a8fc-be0f-4fe7-bd9f-9ec07a294b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:59.740860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337a8fc-be0f-4fe7-bd9f-9ec07a294b71 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.741254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33ae9a-4222-4705-af36-f18c028d237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:59.741432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337a8fc-be0f-4fe7-bd9f-9ec07a294b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.741870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337a8fc-be0f-4fe7-bd9f-9ec07a294b71 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.742056 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33ae9a-4222-4705-af36-f18c028d237f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.742341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33ae9a-4222-4705-af36-f18c028d237f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.742620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33ae9a-4222-4705-af36-f18c028d237f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.743763 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337a8fc-be0f-4fe7-bd9f-9ec07a294b71 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:59.744305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337a8fc-be0f-4fe7-bd9f-9ec07a294b71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:59.745944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337a8fc-be0f-4fe7-bd9f-9ec07a294b71 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:59.752623 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 448/920] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:59.755407 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33ae9a-4222-4705-af36-f18c028d237f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:59.760124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33ae9a-4222-4705-af36-f18c028d237f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:59.760297 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337a8fc-be0f-4fe7-bd9f-9ec07a294b71 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-8e33ae9a-4222-4705-af36-f18c028d237f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:17:59.778696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:17:59.779830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:17:59.780977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:17:59.780977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:17:59.780977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:17:59.780977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:17:59.786323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 473/921] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:17:59.787419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33ae9a-4222-4705-af36-f18c028d237f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.819539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:17:59.877787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337a8fc-be0f-4fe7-bd9f-9ec07a294b71 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:59.913418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7175f04-9c2d-4f03-ad0c-803666291c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:59.914175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33ae9a-4222-4705-af36-f18c028d237f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:17:59.914622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7175f04-9c2d-4f03-ad0c-803666291c0f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.915276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7175f04-9c2d-4f03-ad0c-803666291c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.915823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7175f04-9c2d-4f03-ad0c-803666291c0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.916817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7175f04-9c2d-4f03-ad0c-803666291c0f None admin] RBAC: Adding query filter params (interface=public, service_id=6eb4efbe081c4614bd6c167b85af9613, region_id=RegionOne) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:59.917330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7175f04-9c2d-4f03-ad0c-803666291c0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:59.918916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7175f04-9c2d-4f03-ad0c-803666291c0f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:59.929785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 449/922] 10.222.0.77 () {56 vars in 1251 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/endpoints?service_id=6eb4efbe081c4614bd6c167b85af9613&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:59.931505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7175f04-9c2d-4f03-ad0c-803666291c0f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.958787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9ee2b-0d37-4801-ab1c-4d8d59ed8aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:17:59.959486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9ee2b-0d37-4801-ab1c-4d8d59ed8aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:17:59.959765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9ee2b-0d37-4801-ab1c-4d8d59ed8aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:17:59.960039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9ee2b-0d37-4801-ab1c-4d8d59ed8aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:17:59.960957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9ee2b-0d37-4801-ab1c-4d8d59ed8aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:17:59.961269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9ee2b-0d37-4801-ab1c-4d8d59ed8aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:17:59.963223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9ee2b-0d37-4801-ab1c-4d8d59ed8aa6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:17:59.983976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 474/923] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:17:59.984955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9ee2b-0d37-4801-ab1c-4d8d59ed8aa6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:17:59.992644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:00.049922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7175f04-9c2d-4f03-ad0c-803666291c0f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:00.089865 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ded3d-d038-43c8-85b7-569a73362288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:00.090887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ded3d-d038-43c8-85b7-569a73362288 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:00.091386 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ded3d-d038-43c8-85b7-569a73362288 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:00.091930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ded3d-d038-43c8-85b7-569a73362288 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:00.092877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ded3d-d038-43c8-85b7-569a73362288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:00.094437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ded3d-d038-43c8-85b7-569a73362288 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:00.097857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:00.108396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 450/924] 10.222.0.77 () {56 vars in 1087 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:18:00.123059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9ee2b-0d37-4801-ab1c-4d8d59ed8aa6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:00.157733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f9803-a7d6-45e4-9f47-d104a49e37fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:00.158566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f9803-a7d6-45e4-9f47-d104a49e37fd None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:00.158847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f9803-a7d6-45e4-9f47-d104a49e37fd None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:00.159126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f9803-a7d6-45e4-9f47-d104a49e37fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:00.167857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f9803-a7d6-45e4-9f47-d104a49e37fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:00.169383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f9803-a7d6-45e4-9f47-d104a49e37fd None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-0f3f9803-a7d6-45e4-9f47-d104a49e37fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:18:00.186283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:00.187319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:00.188282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:00.188282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:00.188282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:18:00.188282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:18:00.188282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:18:00.188282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:18:00.188282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:18:00.188282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:18:00.188282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:18:00.188282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:00.192189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 475/925] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Jun 16 17:17:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:00.193740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ded3d-d038-43c8-85b7-569a73362288 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:00.301980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ded3d-d038-43c8-85b7-569a73362288 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:00.315498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:00.338105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9b8a9-b13a-427e-9697-bfeef80d912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:00.338776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9b8a9-b13a-427e-9697-bfeef80d912c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:00.339057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9b8a9-b13a-427e-9697-bfeef80d912c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:00.339329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9b8a9-b13a-427e-9697-bfeef80d912c None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:00.340332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9b8a9-b13a-427e-9697-bfeef80d912c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:00.340643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9b8a9-b13a-427e-9697-bfeef80d912c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:00.342106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9b8a9-b13a-427e-9697-bfeef80d912c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:00.361940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 451/926] 10.222.0.77 () {56 vars in 1149 bytes} [Thu Jun 16 17:18:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:00.367948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f9803-a7d6-45e4-9f47-d104a49e37fd None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:00.476141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f9803-a7d6-45e4-9f47-d104a49e37fd None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:00.513054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2a21b-04e5-411a-b3ac-4e29653c6f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:00.513853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2a21b-04e5-411a-b3ac-4e29653c6f48 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:00.514133 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2a21b-04e5-411a-b3ac-4e29653c6f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:00.514405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2a21b-04e5-411a-b3ac-4e29653c6f48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:00.525871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2a21b-04e5-411a-b3ac-4e29653c6f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:00.527329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2a21b-04e5-411a-b3ac-4e29653c6f48 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:00.537961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-9bd2a21b-04e5-411a-b3ac-4e29653c6f48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:00.549065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:00.552172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:00.553082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:18:00.553082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:00.553082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:00.553082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:00.553082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 476/927] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:00.557191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9b8a9-b13a-427e-9697-bfeef80d912c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:00.667077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9b8a9-b13a-427e-9697-bfeef80d912c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:00.708240 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891daa9-db01-4d13-af28-dfe52fb716dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:00.709208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891daa9-db01-4d13-af28-dfe52fb716dd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:00.709693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891daa9-db01-4d13-af28-dfe52fb716dd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:00.710131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891daa9-db01-4d13-af28-dfe52fb716dd None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:00.710989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891daa9-db01-4d13-af28-dfe52fb716dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:00.711447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891daa9-db01-4d13-af28-dfe52fb716dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:00.713044 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891daa9-db01-4d13-af28-dfe52fb716dd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:00.725452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 452/928] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:00.733747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2a21b-04e5-411a-b3ac-4e29653c6f48 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:00.840643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2a21b-04e5-411a-b3ac-4e29653c6f48 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:00.876638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5819-d663-4e43-a325-b6ff4eb52865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:00.877444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5819-d663-4e43-a325-b6ff4eb52865 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:00.877723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5819-d663-4e43-a325-b6ff4eb52865 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:00.878055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5819-d663-4e43-a325-b6ff4eb52865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:00.886244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5819-d663-4e43-a325-b6ff4eb52865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:00.887969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5819-d663-4e43-a325-b6ff4eb52865 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-3e3d5819-d663-4e43-a325-b6ff4eb52865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:18:00.903352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:00.904325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:00.905189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:18:00.905189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:18:00.905189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:18:00.905189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:18:00.905189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:18:00.905189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:18:00.905189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:00.905189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:00.905189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 477/929] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:00.913152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891daa9-db01-4d13-af28-dfe52fb716dd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:00.948779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:01.022419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891daa9-db01-4d13-af28-dfe52fb716dd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:01.058156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caf0a2-6711-4df9-980a-9ee65cf3c947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:01.058834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caf0a2-6711-4df9-980a-9ee65cf3c947 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:01.059117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caf0a2-6711-4df9-980a-9ee65cf3c947 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:01.059456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caf0a2-6711-4df9-980a-9ee65cf3c947 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:01.060266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caf0a2-6711-4df9-980a-9ee65cf3c947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:01.060576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caf0a2-6711-4df9-980a-9ee65cf3c947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:01.062006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caf0a2-6711-4df9-980a-9ee65cf3c947 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:01.075552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 453/930] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:18:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:01.081536 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5819-d663-4e43-a325-b6ff4eb52865 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:01.147108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:01.193061 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5819-d663-4e43-a325-b6ff4eb52865 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:01.223785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5a990-a73c-4f28-8e07-6e3de059a59f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:01.224090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5a990-a73c-4f28-8e07-6e3de059a59f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:01.224423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5a990-a73c-4f28-8e07-6e3de059a59f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:01.226147 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 454/931] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:01.232275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031549d-b155-47bf-9a12-8a81269b8f0d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:01.232653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031549d-b155-47bf-9a12-8a81269b8f0d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:01.233046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031549d-b155-47bf-9a12-8a81269b8f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:01.234178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cae92-602c-4202-b5a9-9531e8ebfb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:01.235066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cae92-602c-4202-b5a9-9531e8ebfb87 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:01.235349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cae92-602c-4202-b5a9-9531e8ebfb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:01.235621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cae92-602c-4202-b5a9-9531e8ebfb87 None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/9f9b0c02f87340998d1736f2062b7164/roles/288469399b864e5fa238342d9301217b` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:01.237946 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cae92-602c-4202-b5a9-9531e8ebfb87 None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=9f9b0c02f87340998d1736f2062b7164, role_id=288469399b864e5fa238342d9301217b)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:01.239383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cae92-602c-4202-b5a9-9531e8ebfb87 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:01.251361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0031549d-b155-47bf-9a12-8a81269b8f0d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:01.252589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0031549d-b155-47bf-9a12-8a81269b8f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:01.320406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 455/932] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:01.343822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031549d-b155-47bf-9a12-8a81269b8f0d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:01.367731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:01.392324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 478/933] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:18:01 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/9f9b0c02f87340998d1736f2062b7164/roles/288469399b864e5fa238342d9301217b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:18:01.437552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba2c6-f91a-4605-bd26-e31388a4de8c None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:01.437840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba2c6-f91a-4605-bd26-e31388a4de8c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:01.438119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba2c6-f91a-4605-bd26-e31388a4de8c None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:01.439837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 479/934] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:01.445465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0965c4f-367e-4c55-aa2e-1c8c2e136899 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:01.445742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0965c4f-367e-4c55-aa2e-1c8c2e136899 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:01.446020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0965c4f-367e-4c55-aa2e-1c8c2e136899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:01.465864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a0965c4f-367e-4c55-aa2e-1c8c2e136899 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:01.467082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a0965c4f-367e-4c55-aa2e-1c8c2e136899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:01.482820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031549d-b155-47bf-9a12-8a81269b8f0d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:01.525091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99405ae5-d089-4766-8229-242ae013fd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:01.525469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99405ae5-d089-4766-8229-242ae013fd0a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:01.525753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99405ae5-d089-4766-8229-242ae013fd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:01.526026 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99405ae5-d089-4766-8229-242ae013fd0a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:01.526691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99405ae5-d089-4766-8229-242ae013fd0a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:01.528270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99405ae5-d089-4766-8229-242ae013fd0a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-99405ae5-d089-4766-8229-242ae013fd0a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:01.542441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:01.543749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:01.544633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 456/935] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:18:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:01.549520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 480/936] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:01.550632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99405ae5-d089-4766-8229-242ae013fd0a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:01.576937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0965c4f-367e-4c55-aa2e-1c8c2e136899 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:01.641737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:01.678242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99405ae5-d089-4766-8229-242ae013fd0a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:01.700496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:01.705807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0965c4f-367e-4c55-aa2e-1c8c2e136899 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:01.724716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f8417-76aa-4970-bc2d-f7196ef8cc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:01.725740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f8417-76aa-4970-bc2d-f7196ef8cc23 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:01.726263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f8417-76aa-4970-bc2d-f7196ef8cc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:01.727259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f8417-76aa-4970-bc2d-f7196ef8cc23 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:01.728987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f8417-76aa-4970-bc2d-f7196ef8cc23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:01.729507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f8417-76aa-4970-bc2d-f7196ef8cc23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:01.731785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f8417-76aa-4970-bc2d-f7196ef8cc23 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:01.744032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 457/937] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Jun 16 17:18:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:01.744217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:01.744217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:01.744217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:01.744217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:01.744838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:01.745974 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f8417-76aa-4970-bc2d-f7196ef8cc23 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:01.746346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:01.747897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: WARNING keystone.server.flask.common [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 17:18:01.810652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.sql.core [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 17:18:01.810652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 17:18:01.810652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [parameters: {'id': '6736e20d119a463a8382fac6da8a9eee', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 17:18:01.810652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80456) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6736e20d119a463a8382fac6da8a9eee.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6736e20d119a463a8382fac6da8a9eee. Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:18:01.821844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result.read() Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 17:18:01.823596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application yield resource Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise self.value Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application session.commit() Jun 16 17:18:01.824584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.session.flush() Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application compat.raise_( Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 17:18:01.825478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 17:18:01.826386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result.read() Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:18:01.827180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [parameters: {'id': '6736e20d119a463a8382fac6da8a9eee', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:01.830066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:01.831464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6736e20d119a463a8382fac6da8a9eee. Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 481/938] 10.222.0.77 () {60 vars in 1140 bytes} [Thu Jun 16 17:18:01 2022] POST /identity/v3/projects => generated 262 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:01.832600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:01.878498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f8417-76aa-4970-bc2d-f7196ef8cc23 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:01.927849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396193-00ad-438c-995c-bfea66e97734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:01.928931 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396193-00ad-438c-995c-bfea66e97734 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:01.929419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396193-00ad-438c-995c-bfea66e97734 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:01.930333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396193-00ad-438c-995c-bfea66e97734 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:01.931500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396193-00ad-438c-995c-bfea66e97734 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:01.932436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396193-00ad-438c-995c-bfea66e97734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:01.934517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396193-00ad-438c-995c-bfea66e97734 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:01.947712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 458/939] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Jun 16 17:18:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:01.953438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396193-00ad-438c-995c-bfea66e97734 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:01.962732 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645eda8-2f6a-47af-a14e-02bea3c42293 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:01.972566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:01.976132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:01.998794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c1eed-a380-45fc-8898-4dd09f7818be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:01.999737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c1eed-a380-45fc-8898-4dd09f7818be None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.000059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c1eed-a380-45fc-8898-4dd09f7818be None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.000476 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c1eed-a380-45fc-8898-4dd09f7818be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.010201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c1eed-a380-45fc-8898-4dd09f7818be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:02.012151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c1eed-a380-45fc-8898-4dd09f7818be None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-df5c1eed-a380-45fc-8898-4dd09f7818be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:18:02.037268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:02.038680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:02.039875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:18:02.039875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:18:02.039875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:18:02.039875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:18:02.039875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:18:02.039875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:18:02.039875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:02.039875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:02.044548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 482/940] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:02.048137 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c1eed-a380-45fc-8898-4dd09f7818be None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:02.084438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396193-00ad-438c-995c-bfea66e97734 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:02.125657 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd9664-49d1-4bfb-af16-96ac52fa85f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:02.126559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd9664-49d1-4bfb-af16-96ac52fa85f9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.127137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd9664-49d1-4bfb-af16-96ac52fa85f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.127282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd9664-49d1-4bfb-af16-96ac52fa85f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.128288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd9664-49d1-4bfb-af16-96ac52fa85f9 None admin] RBAC: Adding query filter params (interface=public, service_id=da474d79cbba4159a7d17a0915f18ec8, region_id=RegionOne) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:02.128705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd9664-49d1-4bfb-af16-96ac52fa85f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:02.130156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd9664-49d1-4bfb-af16-96ac52fa85f9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:02.140529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 459/941] 10.222.0.77 () {56 vars in 1251 bytes} [Thu Jun 16 17:18:01 2022] GET /identity/v3/endpoints?service_id=da474d79cbba4159a7d17a0915f18ec8&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:02.142301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd9664-49d1-4bfb-af16-96ac52fa85f9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:02.187494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c1eed-a380-45fc-8898-4dd09f7818be None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:02.227429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:02.242401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b0bc5-f113-4cce-93f5-afc866967e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:02.243871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b0bc5-f113-4cce-93f5-afc866967e48 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.244204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b0bc5-f113-4cce-93f5-afc866967e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.244482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b0bc5-f113-4cce-93f5-afc866967e48 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.245247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b0bc5-f113-4cce-93f5-afc866967e48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:02.245553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b0bc5-f113-4cce-93f5-afc866967e48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:02.247004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b0bc5-f113-4cce-93f5-afc866967e48 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:02.257273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd9664-49d1-4bfb-af16-96ac52fa85f9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:02.276609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 483/942] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:18:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:02.301285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e7351-9a30-443f-8e1b-66a0ddbde9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:02.302344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e7351-9a30-443f-8e1b-66a0ddbde9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.302867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e7351-9a30-443f-8e1b-66a0ddbde9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.303359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e7351-9a30-443f-8e1b-66a0ddbde9f9 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.304342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e7351-9a30-443f-8e1b-66a0ddbde9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:02.307551 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e7351-9a30-443f-8e1b-66a0ddbde9f9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:02.315452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 460/943] 10.222.0.77 () {56 vars in 1087 bytes} [Thu Jun 16 17:18:02 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:18:02.461636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1769f-8bc0-4855-9ddc-0deba5507ca6 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.462849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1769f-8bc0-4855-9ddc-0deba5507ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.462849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1769f-8bc0-4855-9ddc-0deba5507ca6 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.464522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 484/944] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:02.470028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307dc30-ca94-44d1-ac1c-15a444c6b524 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.470941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307dc30-ca94-44d1-ac1c-15a444c6b524 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.471424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307dc30-ca94-44d1-ac1c-15a444c6b524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.492743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2307dc30-ca94-44d1-ac1c-15a444c6b524 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:02.495369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2307dc30-ca94-44d1-ac1c-15a444c6b524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:02.584110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 461/945] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:02.603636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1769f-8bc0-4855-9ddc-0deba5507ca6 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:02.631793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:02.716726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1769f-8bc0-4855-9ddc-0deba5507ca6 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:02.754372 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bcf52-0397-4e19-9cfc-702bdea88e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:02.755187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bcf52-0397-4e19-9cfc-702bdea88e97 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.755469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bcf52-0397-4e19-9cfc-702bdea88e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.755740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bcf52-0397-4e19-9cfc-702bdea88e97 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.756421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bcf52-0397-4e19-9cfc-702bdea88e97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:02.757789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bcf52-0397-4e19-9cfc-702bdea88e97 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-887bcf52-0397-4e19-9cfc-702bdea88e97 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:02.770791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:02.771889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 17:18:02.772871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:02.776455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 485/946] 10.222.0.77 () {56 vars in 1132 bytes} [Thu Jun 16 17:18:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:02.779374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307dc30-ca94-44d1-ac1c-15a444c6b524 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:02.860569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:02.890262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307dc30-ca94-44d1-ac1c-15a444c6b524 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:02.927085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f69293-0242-4dbb-ae07-84d4f116596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:02.927756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f69293-0242-4dbb-ae07-84d4f116596c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:02.928043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f69293-0242-4dbb-ae07-84d4f116596c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:02.928350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f69293-0242-4dbb-ae07-84d4f116596c None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:02.929048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f69293-0242-4dbb-ae07-84d4f116596c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:02.929357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f69293-0242-4dbb-ae07-84d4f116596c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:02.930741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f69293-0242-4dbb-ae07-84d4f116596c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:02.935777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 462/947] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:18:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:02.941535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bcf52-0397-4e19-9cfc-702bdea88e97 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:03.041746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:03.051275 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bcf52-0397-4e19-9cfc-702bdea88e97 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:03.087464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e4abd-4347-40e5-a244-f79038b8c088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:03.088391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e4abd-4347-40e5-a244-f79038b8c088 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:03.088675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e4abd-4347-40e5-a244-f79038b8c088 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:03.088952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e4abd-4347-40e5-a244-f79038b8c088 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:03.089656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e4abd-4347-40e5-a244-f79038b8c088 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:03.089966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e4abd-4347-40e5-a244-f79038b8c088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:03.091334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e4abd-4347-40e5-a244-f79038b8c088 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:03.100276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 486/948] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:18:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:03.105164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f69293-0242-4dbb-ae07-84d4f116596c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:03.219609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f69293-0242-4dbb-ae07-84d4f116596c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:03.255115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b56c6-1ae2-4134-b7bc-3edf4eee765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:03.255784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b56c6-1ae2-4134-b7bc-3edf4eee765c None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:03.256064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b56c6-1ae2-4134-b7bc-3edf4eee765c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:03.256366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b56c6-1ae2-4134-b7bc-3edf4eee765c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:03.257094 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b56c6-1ae2-4134-b7bc-3edf4eee765c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:03.258446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b56c6-1ae2-4134-b7bc-3edf4eee765c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:03.262251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:03.374312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 463/949] 10.222.0.77 () {60 vars in 1144 bytes} [Thu Jun 16 17:18:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:18:03.712955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83454103-021b-4c99-904f-462a52787f5a None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:03.713473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83454103-021b-4c99-904f-462a52787f5a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:03.713552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83454103-021b-4c99-904f-462a52787f5a None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:03.715007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 487/950] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:03.720592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9e308-9e66-4aed-9400-8d12e409fe9d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:03.721407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9e308-9e66-4aed-9400-8d12e409fe9d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:03.721892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9e308-9e66-4aed-9400-8d12e409fe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:03.740708 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fbd9e308-9e66-4aed-9400-8d12e409fe9d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:03.742341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fbd9e308-9e66-4aed-9400-8d12e409fe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:03.823387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 464/951] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:03.847613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83454103-021b-4c99-904f-462a52787f5a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:03.961383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83454103-021b-4c99-904f-462a52787f5a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:03.998066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae35387-e137-425f-9eab-f2ecfe940c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:03.998893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35387-e137-425f-9eab-f2ecfe940c9d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:03.999178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35387-e137-425f-9eab-f2ecfe940c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:03.999452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35387-e137-425f-9eab-f2ecfe940c9d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.010778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae35387-e137-425f-9eab-f2ecfe940c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-6ae35387-e137-425f-9eab-f2ecfe940c9d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:18:04.019562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:04.020544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:04.021383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 488/952] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Jun 16 17:18:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:04.029237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9e308-9e66-4aed-9400-8d12e409fe9d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:04.144617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9e308-9e66-4aed-9400-8d12e409fe9d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:04.163803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:04.188153 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e4814-8d4f-48e7-8c88-a3a7015ef54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:04.188836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4814-8d4f-48e7-8c88-a3a7015ef54b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.189116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4814-8d4f-48e7-8c88-a3a7015ef54b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.189387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4814-8d4f-48e7-8c88-a3a7015ef54b None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.190128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e4814-8d4f-48e7-8c88-a3a7015ef54b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:04.190430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e4814-8d4f-48e7-8c88-a3a7015ef54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:04.191788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e4814-8d4f-48e7-8c88-a3a7015ef54b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:04.200561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 465/953] 10.222.0.77 () {56 vars in 1115 bytes} [Thu Jun 16 17:18:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:04.206142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae35387-e137-425f-9eab-f2ecfe940c9d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:04.244699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:04.323329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae35387-e137-425f-9eab-f2ecfe940c9d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:04.359370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa934ea7-8bed-46ce-9b81-2685167bc422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:04.360251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa934ea7-8bed-46ce-9b81-2685167bc422 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.360537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa934ea7-8bed-46ce-9b81-2685167bc422 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.360810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa934ea7-8bed-46ce-9b81-2685167bc422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.371768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa934ea7-8bed-46ce-9b81-2685167bc422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:04.373247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa934ea7-8bed-46ce-9b81-2685167bc422 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-aa934ea7-8bed-46ce-9b81-2685167bc422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:04.391406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:04.392351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:04.393304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:18:04.393304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:04.393304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:04.393304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:04.393304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 489/954] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:04.400423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e4814-8d4f-48e7-8c88-a3a7015ef54b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:04.507617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e4814-8d4f-48e7-8c88-a3a7015ef54b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:04.542791 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcde8f-f619-4c21-a570-26d04168fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:04.543462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcde8f-f619-4c21-a570-26d04168fc93 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.543745 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcde8f-f619-4c21-a570-26d04168fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.544019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcde8f-f619-4c21-a570-26d04168fc93 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.544762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcde8f-f619-4c21-a570-26d04168fc93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:04.545066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcde8f-f619-4c21-a570-26d04168fc93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:04.546438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcde8f-f619-4c21-a570-26d04168fc93 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:04.560690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 466/955] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:04.566400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa934ea7-8bed-46ce-9b81-2685167bc422 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:04.635930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8fdd2-4926-4465-939f-970e8a6ca485 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.636463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8fdd2-4926-4465-939f-970e8a6ca485 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.636463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8fdd2-4926-4465-939f-970e8a6ca485 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.639111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 467/956] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:04.644880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854996-b3bd-47cd-9ae8-655117049b87 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.645161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854996-b3bd-47cd-9ae8-655117049b87 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.645436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854996-b3bd-47cd-9ae8-655117049b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.653286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:04.663575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2b854996-b3bd-47cd-9ae8-655117049b87 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:04.665314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2b854996-b3bd-47cd-9ae8-655117049b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:04.694806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa934ea7-8bed-46ce-9b81-2685167bc422 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:04.704441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:04.733415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 468/957] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:04.734769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee0ecc-476a-4b43-bfd8-96120eb1ca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:04.735641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee0ecc-476a-4b43-bfd8-96120eb1ca26 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.735931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee0ecc-476a-4b43-bfd8-96120eb1ca26 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.738652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee0ecc-476a-4b43-bfd8-96120eb1ca26 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.738803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8a435-6a2a-453c-97b4-f38a9251f997 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.738803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8a435-6a2a-453c-97b4-f38a9251f997 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.738803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8a435-6a2a-453c-97b4-f38a9251f997 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.741406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 469/958] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:04.748808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac46c4d-f7ae-42a8-81e5-5f42080067f5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.749279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac46c4d-f7ae-42a8-81e5-5f42080067f5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.749394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee0ecc-476a-4b43-bfd8-96120eb1ca26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:04.749799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac46c4d-f7ae-42a8-81e5-5f42080067f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.751141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee0ecc-476a-4b43-bfd8-96120eb1ca26 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:04.767362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1ac46c4d-f7ae-42a8-81e5-5f42080067f5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-16ee0ecc-476a-4b43-bfd8-96120eb1ca26 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:18:04.768112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:04.769043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:04.770001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:04.770001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:04.770001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:18:04.770001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:18:04.770001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:18:04.770001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:18:04.770001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:18:04.770001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:18:04.770001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 17:18:04.770001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:04.770555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1ac46c4d-f7ae-42a8-81e5-5f42080067f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:04.771368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 490/959] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Jun 16 17:18:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:04.772968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee0ecc-476a-4b43-bfd8-96120eb1ca26 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:04.840617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 470/960] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:04.841454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac46c4d-f7ae-42a8-81e5-5f42080067f5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:04.905209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee0ecc-476a-4b43-bfd8-96120eb1ca26 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:04.931474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:04.942713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347c315-a942-439c-b97f-9c0d1bf48447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:04.943520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347c315-a942-439c-b97f-9c0d1bf48447 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.943806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347c315-a942-439c-b97f-9c0d1bf48447 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.944110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347c315-a942-439c-b97f-9c0d1bf48447 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.944253 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:04.944760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347c315-a942-439c-b97f-9c0d1bf48447 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:04.946166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347c315-a942-439c-b97f-9c0d1bf48447 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:04.948376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac46c4d-f7ae-42a8-81e5-5f42080067f5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-9347c315-a942-439c-b97f-9c0d1bf48447 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:04.958449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:04.959453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:04.960300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 491/961] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:18:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:04.961117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347c315-a942-439c-b97f-9c0d1bf48447 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:04.988785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05244-2804-44ff-9f5d-fb5081c14eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:04.989466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05244-2804-44ff-9f5d-fb5081c14eef None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:04.989748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05244-2804-44ff-9f5d-fb5081c14eef None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:04.990025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05244-2804-44ff-9f5d-fb5081c14eef None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:04.990848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f05244-2804-44ff-9f5d-fb5081c14eef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:04.991159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f05244-2804-44ff-9f5d-fb5081c14eef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:04.992635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f05244-2804-44ff-9f5d-fb5081c14eef None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:05.010078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 471/962] 10.222.0.77 () {56 vars in 1149 bytes} [Thu Jun 16 17:18:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:05.011570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05244-2804-44ff-9f5d-fb5081c14eef None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:05.069717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347c315-a942-439c-b97f-9c0d1bf48447 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:05.104975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9271b-99b1-4a1d-864b-5182b522295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:05.105650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9271b-99b1-4a1d-864b-5182b522295d None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.105935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9271b-99b1-4a1d-864b-5182b522295d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.106212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9271b-99b1-4a1d-864b-5182b522295d None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.106911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9271b-99b1-4a1d-864b-5182b522295d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:05.108393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9271b-99b1-4a1d-864b-5182b522295d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:05.112617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05244-2804-44ff-9f5d-fb5081c14eef None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:05.145917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64170d5-4b6c-426b-969c-7f08b3f6a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:05.146587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64170d5-4b6c-426b-969c-7f08b3f6a49d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.146866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64170d5-4b6c-426b-969c-7f08b3f6a49d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.147141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64170d5-4b6c-426b-969c-7f08b3f6a49d None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.147864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64170d5-4b6c-426b-969c-7f08b3f6a49d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:05.148204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64170d5-4b6c-426b-969c-7f08b3f6a49d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:05.150170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64170d5-4b6c-426b-969c-7f08b3f6a49d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:05.154755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 472/963] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Jun 16 17:18:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:05.155573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64170d5-4b6c-426b-969c-7f08b3f6a49d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:05.215526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.sql.core [None req-c5a9271b-99b1-4a1d-864b-5182b522295d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 17:18:05.215526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 17:18:05.215526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [parameters: {'user_id': '1371677358cf4738892941f5cfd14572', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 17:18:05.215526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80456) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-c5a9271b-99b1-4a1d-864b-5182b522295d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result.read() Jun 16 17:18:05.222975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:18:05.233833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application yield resource Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application next(self.gen) Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise self.value Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application session.commit() Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 17:18:05.234809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.session.flush() Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application compat.raise_( Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 17:18:05.235721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 17:18:05.236699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application conn.query(q) Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application result.read() Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 17:18:05.237642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [parameters: {'user_id': '1371677358cf4738892941f5cfd14572', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:05.238517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 17:18:05.239368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 17:18:05.240621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 17:18:05.240621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 17:18:05.240621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 17:18:05.240621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 17:18:05.240621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 17:18:05.240621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:05.240621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 492/964] 10.222.0.77 () {60 vars in 1131 bytes} [Thu Jun 16 17:18:04 2022] POST /identity/v3/users => generated 160 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:05.240621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9271b-99b1-4a1d-864b-5182b522295d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:05.267204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64170d5-4b6c-426b-969c-7f08b3f6a49d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:05.277526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:05.288618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:05.306422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc2d13-8e0f-4df3-94bc-baf4e409cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:05.307088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2d13-8e0f-4df3-94bc-baf4e409cdce None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.307375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2d13-8e0f-4df3-94bc-baf4e409cdce None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.307651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2d13-8e0f-4df3-94bc-baf4e409cdce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.342744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9271b-99b1-4a1d-864b-5182b522295d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:05.377354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de63120-1da2-41ef-aefa-306f375acc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:05.378031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63120-1da2-41ef-aefa-306f375acc67 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.378318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63120-1da2-41ef-aefa-306f375acc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.378601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63120-1da2-41ef-aefa-306f375acc67 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.379300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de63120-1da2-41ef-aefa-306f375acc67 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:05.379611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de63120-1da2-41ef-aefa-306f375acc67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:05.380654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc2d13-8e0f-4df3-94bc-baf4e409cdce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:05.381210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de63120-1da2-41ef-aefa-306f375acc67 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:05.382832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc2d13-8e0f-4df3-94bc-baf4e409cdce None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:05.390278 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 493/965] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Jun 16 17:18:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:05.390917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de63120-1da2-41ef-aefa-306f375acc67 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:05.411368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:05.502066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 473/966] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:18:05.502066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc2d13-8e0f-4df3-94bc-baf4e409cdce None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:05.504819 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de63120-1da2-41ef-aefa-306f375acc67 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:05.518929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:05.539314 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b73e1-ecd8-4fff-b497-41c75764d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:05.540927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b73e1-ecd8-4fff-b497-41c75764d288 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.541140 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b73e1-ecd8-4fff-b497-41c75764d288 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.541370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b73e1-ecd8-4fff-b497-41c75764d288 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.549404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b73e1-ecd8-4fff-b497-41c75764d288 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:05.550832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b73e1-ecd8-4fff-b497-41c75764d288 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-639b73e1-ecd8-4fff-b497-41c75764d288 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:18:05.570159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:05.571290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 494/967] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:18:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:05.577038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b73e1-ecd8-4fff-b497-41c75764d288 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:05.642263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc2d13-8e0f-4df3-94bc-baf4e409cdce None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:05.664221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:05.679769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7346de-969e-49c3-94ae-5c889c6b506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:05.680500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7346de-969e-49c3-94ae-5c889c6b506b None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.680889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7346de-969e-49c3-94ae-5c889c6b506b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.681256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7346de-969e-49c3-94ae-5c889c6b506b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.681995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7346de-969e-49c3-94ae-5c889c6b506b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:05.683355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7346de-969e-49c3-94ae-5c889c6b506b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:05.697228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b73e1-ecd8-4fff-b497-41c75764d288 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:05.731041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcef67-8026-4ed0-81d1-50c2e55151b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:05.731828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcef67-8026-4ed0-81d1-50c2e55151b3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.732146 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcef67-8026-4ed0-81d1-50c2e55151b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.732423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcef67-8026-4ed0-81d1-50c2e55151b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.742763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcef67-8026-4ed0-81d1-50c2e55151b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:05.744278 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcef67-8026-4ed0-81d1-50c2e55151b3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-d0bcef67-8026-4ed0-81d1-50c2e55151b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:05.760896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:05.761919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:05.763201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:18:05.763201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:05.763201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:05.763201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:05.763201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 495/968] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:05.763625 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcef67-8026-4ed0-81d1-50c2e55151b3 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:05.790442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 474/969] 10.222.0.77 () {60 vars in 1144 bytes} [Thu Jun 16 17:18:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:18:05.790442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1de4-1cd0-4435-98e6-c3ec45ccbc13 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.790442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1de4-1cd0-4435-98e6-c3ec45ccbc13 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.790442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1de4-1cd0-4435-98e6-c3ec45ccbc13 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.790442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 475/970] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:05.790442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc1de4-1cd0-4435-98e6-c3ec45ccbc13 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:05.803726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:05.891592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcef67-8026-4ed0-81d1-50c2e55151b3 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:05.916569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc1de4-1cd0-4435-98e6-c3ec45ccbc13 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:05.935264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597a153-c73a-4303-a431-47e7384a6ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:05.936113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597a153-c73a-4303-a431-47e7384a6ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.936401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597a153-c73a-4303-a431-47e7384a6ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.936678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597a153-c73a-4303-a431-47e7384a6ba3 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.937575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597a153-c73a-4303-a431-47e7384a6ba3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:05.937884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597a153-c73a-4303-a431-47e7384a6ba3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:05.939339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597a153-c73a-4303-a431-47e7384a6ba3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:05.959821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e555a2-5982-426a-bbd4-4423749fe0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:05.960611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e555a2-5982-426a-bbd4-4423749fe0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.960905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e555a2-5982-426a-bbd4-4423749fe0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.961187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e555a2-5982-426a-bbd4-4423749fe0b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.962458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e555a2-5982-426a-bbd4-4423749fe0b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:05.962767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e555a2-5982-426a-bbd4-4423749fe0b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:05.964171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e555a2-5982-426a-bbd4-4423749fe0b0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:05.976396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 476/971] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:05.979374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70536c03-c759-4faf-b75e-a227e7cbfcc7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:05.979901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70536c03-c759-4faf-b75e-a227e7cbfcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:05.980410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70536c03-c759-4faf-b75e-a227e7cbfcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:05.980780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 496/972] 10.222.0.77 () {56 vars in 1101 bytes} [Thu Jun 16 17:18:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:05.983012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597a153-c73a-4303-a431-47e7384a6ba3 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:05.999786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-70536c03-c759-4faf-b75e-a227e7cbfcc7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:06.001201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-70536c03-c759-4faf-b75e-a227e7cbfcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:06.041504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:06.091068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:06.120103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 477/973] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:06.120308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597a153-c73a-4303-a431-47e7384a6ba3 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:06.139082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70536c03-c759-4faf-b75e-a227e7cbfcc7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:06.162132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c67048-f780-4030-bf08-45637d457643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:06.163064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c67048-f780-4030-bf08-45637d457643 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:06.163349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c67048-f780-4030-bf08-45637d457643 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:06.163626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c67048-f780-4030-bf08-45637d457643 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:06.176202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c67048-f780-4030-bf08-45637d457643 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:06.178773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c67048-f780-4030-bf08-45637d457643 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-c5c67048-f780-4030-bf08-45637d457643 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:18:06.195308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:06.197212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:06.198120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:18:06.198120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:18:06.198120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:18:06.198120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:18:06.198120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:18:06.198120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:18:06.198120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:06.198120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:06.198120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 497/974] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:06.202970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c67048-f780-4030-bf08-45637d457643 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:06.269669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70536c03-c759-4faf-b75e-a227e7cbfcc7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:06.309611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80112-4f8e-4292-8588-9071918b4791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:06.310383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80112-4f8e-4292-8588-9071918b4791 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:06.310666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80112-4f8e-4292-8588-9071918b4791 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:06.310953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80112-4f8e-4292-8588-9071918b4791 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:06.311589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b80112-4f8e-4292-8588-9071918b4791 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:06.312991 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b80112-4f8e-4292-8588-9071918b4791 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:06.320199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c67048-f780-4030-bf08-45637d457643 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-96b80112-4f8e-4292-8588-9071918b4791 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:06.326840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:06.327841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:06.333488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 478/975] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:18:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:06.334511 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80112-4f8e-4292-8588-9071918b4791 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:06.364003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:06.364287 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff39da-92d1-454a-8f3a-12ed44a8bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:06.364942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff39da-92d1-454a-8f3a-12ed44a8bab5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:06.365225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff39da-92d1-454a-8f3a-12ed44a8bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:06.365875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff39da-92d1-454a-8f3a-12ed44a8bab5 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:06.366669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff39da-92d1-454a-8f3a-12ed44a8bab5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:06.366980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff39da-92d1-454a-8f3a-12ed44a8bab5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:06.368526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff39da-92d1-454a-8f3a-12ed44a8bab5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:06.381711 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 498/976] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:06.388676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff39da-92d1-454a-8f3a-12ed44a8bab5 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:06.393103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:06.442782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80112-4f8e-4292-8588-9071918b4791 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:06.480221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce448e-fc3e-41ab-9188-8e29c7bd094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:06.481009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce448e-fc3e-41ab-9188-8e29c7bd094b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:06.481293 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce448e-fc3e-41ab-9188-8e29c7bd094b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:06.481567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce448e-fc3e-41ab-9188-8e29c7bd094b None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:06.482256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce448e-fc3e-41ab-9188-8e29c7bd094b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:06.482624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce448e-fc3e-41ab-9188-8e29c7bd094b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:06.484309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce448e-fc3e-41ab-9188-8e29c7bd094b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:06.489346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff39da-92d1-454a-8f3a-12ed44a8bab5 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:06.494823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 479/977] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:18:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:06.495677 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce448e-fc3e-41ab-9188-8e29c7bd094b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:06.525091 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d66cb8-7baf-4ec5-81a9-382cfc8608d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:06.525759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d66cb8-7baf-4ec5-81a9-382cfc8608d5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:06.526047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d66cb8-7baf-4ec5-81a9-382cfc8608d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:06.526333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d66cb8-7baf-4ec5-81a9-382cfc8608d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:06.527157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d66cb8-7baf-4ec5-81a9-382cfc8608d5 None admin] RBAC: Adding query filter params (role.id=288469399b864e5fa238342d9301217b, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=9f9b0c02f87340998d1736f2062b7164) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:06.527473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d66cb8-7baf-4ec5-81a9-382cfc8608d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:06.528928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d66cb8-7baf-4ec5-81a9-382cfc8608d5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:06.540107 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 499/978] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:18:06 2022] GET /identity/v3/role_assignments?user.id=9f9b0c02f87340998d1736f2062b7164&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=288469399b864e5fa238342d9301217b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:06.609510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:06.620305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce448e-fc3e-41ab-9188-8e29c7bd094b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:06.656997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d8e3-8740-4369-af75-612952cab561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:06.657686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d8e3-8740-4369-af75-612952cab561 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:06.657967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d8e3-8740-4369-af75-612952cab561 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:06.658242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d8e3-8740-4369-af75-612952cab561 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:06.658950 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d8e3-8740-4369-af75-612952cab561 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:06.659260 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d8e3-8740-4369-af75-612952cab561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:06.660709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d8e3-8740-4369-af75-612952cab561 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:06.666739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 480/979] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:18:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:08.210219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b1f94-ac9a-4317-ba99-a2909db9c859 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:08.210758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b1f94-ac9a-4317-ba99-a2909db9c859 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:08.210758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b1f94-ac9a-4317-ba99-a2909db9c859 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:08.213475 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 500/980] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:08.218779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1717b-28d3-4a5c-a4ae-f874d2197844 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:08.219235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1717b-28d3-4a5c-a4ae-f874d2197844 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:08.219318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1717b-28d3-4a5c-a4ae-f874d2197844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:08.237251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-cdb1717b-28d3-4a5c-a4ae-f874d2197844 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:08.238493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cdb1717b-28d3-4a5c-a4ae-f874d2197844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:08.316099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 481/981] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:08.335016 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b1f94-ac9a-4317-ba99-a2909db9c859 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:08.406779 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:08.441303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b1f94-ac9a-4317-ba99-a2909db9c859 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:08.477757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b13ca-806a-4054-b8f3-3d6253254d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:08.478468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b13ca-806a-4054-b8f3-3d6253254d9a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:08.478750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b13ca-806a-4054-b8f3-3d6253254d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:08.479034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b13ca-806a-4054-b8f3-3d6253254d9a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:08.479681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b13ca-806a-4054-b8f3-3d6253254d9a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:08.481081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b13ca-806a-4054-b8f3-3d6253254d9a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-302b13ca-806a-4054-b8f3-3d6253254d9a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:08.493510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:08.494501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:08.495346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:08.500707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1717b-28d3-4a5c-a4ae-f874d2197844 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:08.512429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 501/982] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:18:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:08.600175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:08.616809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1717b-28d3-4a5c-a4ae-f874d2197844 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:08.653030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01534c08-4681-40c4-86a3-d5bb9ccd2097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:08.653728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534c08-4681-40c4-86a3-d5bb9ccd2097 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:08.654014 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534c08-4681-40c4-86a3-d5bb9ccd2097 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:08.654295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534c08-4681-40c4-86a3-d5bb9ccd2097 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:08.655022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01534c08-4681-40c4-86a3-d5bb9ccd2097 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:08.655333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01534c08-4681-40c4-86a3-d5bb9ccd2097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:08.656821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01534c08-4681-40c4-86a3-d5bb9ccd2097 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:08.667335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 482/983] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Jun 16 17:18:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:08.669133 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b13ca-806a-4054-b8f3-3d6253254d9a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:08.723141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b4f5d-c9e3-472c-8f48-df033f7bcb13 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:08.723473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b4f5d-c9e3-472c-8f48-df033f7bcb13 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:08.723706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b4f5d-c9e3-472c-8f48-df033f7bcb13 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:08.725219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 483/984] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:08.730981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59b54e-7656-41b4-9a61-7e5489bd65d1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:08.731263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59b54e-7656-41b4-9a61-7e5489bd65d1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:08.731913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59b54e-7656-41b4-9a61-7e5489bd65d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:08.750401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2d59b54e-7656-41b4-9a61-7e5489bd65d1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:08.751633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2d59b54e-7656-41b4-9a61-7e5489bd65d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:08.782062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b13ca-806a-4054-b8f3-3d6253254d9a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:08.812465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:08.817995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f10aaf-1808-45a1-aa3d-792bce9c8913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:08.818672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f10aaf-1808-45a1-aa3d-792bce9c8913 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:08.818957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f10aaf-1808-45a1-aa3d-792bce9c8913 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:08.819233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f10aaf-1808-45a1-aa3d-792bce9c8913 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:08.819930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f10aaf-1808-45a1-aa3d-792bce9c8913 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:08.820266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f10aaf-1808-45a1-aa3d-792bce9c8913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:08.821683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f10aaf-1808-45a1-aa3d-792bce9c8913 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:08.825178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 484/985] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:08.831568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c950-f506-42cb-8d39-9f9a576be71d None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:08.831702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 502/986] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Jun 16 17:18:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:08.831782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c950-f506-42cb-8d39-9f9a576be71d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:08.831782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c950-f506-42cb-8d39-9f9a576be71d None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:08.831782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 485/987] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:08.832628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f10aaf-1808-45a1-aa3d-792bce9c8913 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:08.833343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149779-9da0-4ba5-a6f3-4d15f9e820c5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:08.833708 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149779-9da0-4ba5-a6f3-4d15f9e820c5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:08.833915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149779-9da0-4ba5-a6f3-4d15f9e820c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:08.851005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c0149779-9da0-4ba5-a6f3-4d15f9e820c5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:08.862335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c0149779-9da0-4ba5-a6f3-4d15f9e820c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:08.918313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 486/988] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:08.919148 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149779-9da0-4ba5-a6f3-4d15f9e820c5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:08.933175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f10aaf-1808-45a1-aa3d-792bce9c8913 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:08.933719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:08.968380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fb553-fb3b-4a0b-bcb3-a7389d7b3c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:08.969426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb553-fb3b-4a0b-bcb3-a7389d7b3c22 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:08.969891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb553-fb3b-4a0b-bcb3-a7389d7b3c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:08.970344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb553-fb3b-4a0b-bcb3-a7389d7b3c22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:08.971730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fb553-fb3b-4a0b-bcb3-a7389d7b3c22 None admin] RBAC: Adding query filter params (interface=admin, service_id=da474d79cbba4159a7d17a0915f18ec8, region_id=RegionOne) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:08.972322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fb553-fb3b-4a0b-bcb3-a7389d7b3c22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:08.974373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fb553-fb3b-4a0b-bcb3-a7389d7b3c22 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:08.981132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 503/989] 10.222.0.77 () {56 vars in 1249 bytes} [Thu Jun 16 17:18:08 2022] GET /identity/v3/endpoints?service_id=da474d79cbba4159a7d17a0915f18ec8&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:08.981830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fb553-fb3b-4a0b-bcb3-a7389d7b3c22 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:09.034861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149779-9da0-4ba5-a6f3-4d15f9e820c5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:09.043916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:09.070021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24789ee0-c672-499c-90fc-cb4700c73dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:09.071390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24789ee0-c672-499c-90fc-cb4700c73dcf None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.071991 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24789ee0-c672-499c-90fc-cb4700c73dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.072129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24789ee0-c672-499c-90fc-cb4700c73dcf None admin] PATH_INFO: `/v3/services/image` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.072792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24789ee0-c672-499c-90fc-cb4700c73dcf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:09.074264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24789ee0-c672-499c-90fc-cb4700c73dcf None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:09.084047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fb553-fb3b-4a0b-bcb3-a7389d7b3c22 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-24789ee0-c672-499c-90fc-cb4700c73dcf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:09.086457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:09.087995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:09.089011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 487/990] 10.222.0.77 () {56 vars in 1105 bytes} [Thu Jun 16 17:18:08 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:09.089811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24789ee0-c672-499c-90fc-cb4700c73dcf None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:09.120985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66dbed-f1db-42d2-9317-a201020158d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:09.121656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66dbed-f1db-42d2-9317-a201020158d0 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.121945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66dbed-f1db-42d2-9317-a201020158d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.122226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66dbed-f1db-42d2-9317-a201020158d0 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.122936 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66dbed-f1db-42d2-9317-a201020158d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:09.124458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66dbed-f1db-42d2-9317-a201020158d0 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:09.160976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:09.190293 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24789ee0-c672-499c-90fc-cb4700c73dcf None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:09.222501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd63bbe-13ee-488d-91e9-63000fe25495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:09.223201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd63bbe-13ee-488d-91e9-63000fe25495 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.223487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd63bbe-13ee-488d-91e9-63000fe25495 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.223792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd63bbe-13ee-488d-91e9-63000fe25495 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.224497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd63bbe-13ee-488d-91e9-63000fe25495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:09.225857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd63bbe-13ee-488d-91e9-63000fe25495 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:09.232537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 488/991] 10.222.0.77 () {56 vars in 1087 bytes} [Thu Jun 16 17:18:09 2022] GET /identity/v3/services => generated 1497 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:18:09.233252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd63bbe-13ee-488d-91e9-63000fe25495 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:09.254701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 504/992] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:18:08 2022] POST /identity/v3/services => generated 242 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:18:09.354711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd63bbe-13ee-488d-91e9-63000fe25495 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:09.396542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:09.403567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b9bab-9ca2-4af9-abb4-69537fad1709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:09.404292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9bab-9ca2-4af9-abb4-69537fad1709 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.404577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9bab-9ca2-4af9-abb4-69537fad1709 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.404852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9bab-9ca2-4af9-abb4-69537fad1709 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.405658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b9bab-9ca2-4af9-abb4-69537fad1709 None admin] RBAC: Adding query filter params (name=image) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:09.405969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b9bab-9ca2-4af9-abb4-69537fad1709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:09.407368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b9bab-9ca2-4af9-abb4-69537fad1709 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:09.412964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 489/993] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:09.418960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66dbed-f1db-42d2-9317-a201020158d0 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:09.523264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66dbed-f1db-42d2-9317-a201020158d0 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:09.545124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:09.561987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d09f0-04da-4329-8afe-bd73daf9f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:09.562664 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d09f0-04da-4329-8afe-bd73daf9f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:09.577305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d09f0-04da-4329-8afe-bd73daf9f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:09.577305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d09f0-04da-4329-8afe-bd73daf9f8b0 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:09.577305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d09f0-04da-4329-8afe-bd73daf9f8b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:09.577305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d09f0-04da-4329-8afe-bd73daf9f8b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:09.577305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d09f0-04da-4329-8afe-bd73daf9f8b0 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:09.577305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 505/994] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:11.407636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25815a9-725b-4962-89db-703a7bd7f312 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:11.408280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25815a9-725b-4962-89db-703a7bd7f312 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:11.408280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25815a9-725b-4962-89db-703a7bd7f312 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:11.409851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 490/995] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:11.416540 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bc12-b65d-4711-9961-034241287eb8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:11.417037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bc12-b65d-4711-9961-034241287eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:11.417113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bc12-b65d-4711-9961-034241287eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:11.434879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9c84bc12-b65d-4711-9961-034241287eb8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:11.436533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9c84bc12-b65d-4711-9961-034241287eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:11.453110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba3036-5329-4aa8-ad47-1331b6adc530 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:11.453394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba3036-5329-4aa8-ad47-1331b6adc530 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:11.453667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba3036-5329-4aa8-ad47-1331b6adc530 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:11.455138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 491/996] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:11.459638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423ed4-fd19-456d-8558-a7d4ea03c14e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:11.459924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423ed4-fd19-456d-8558-a7d4ea03c14e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:11.460237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423ed4-fd19-456d-8558-a7d4ea03c14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:11.476714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0e423ed4-fd19-456d-8558-a7d4ea03c14e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:11.478770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0e423ed4-fd19-456d-8558-a7d4ea03c14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:11.516260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 506/997] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:11.536651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84bc12-b65d-4711-9961-034241287eb8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:11.554586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 492/998] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:11.577793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423ed4-fd19-456d-8558-a7d4ea03c14e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:11.650347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84bc12-b65d-4711-9961-034241287eb8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:11.668128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:11.689346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd0139-0bda-4063-8bc3-e365b60f2f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:11.690062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423ed4-fd19-456d-8558-a7d4ea03c14e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:11.690174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd0139-0bda-4063-8bc3-e365b60f2f8d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:11.690418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd0139-0bda-4063-8bc3-e365b60f2f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:11.690692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd0139-0bda-4063-8bc3-e365b60f2f8d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:11.691332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd0139-0bda-4063-8bc3-e365b60f2f8d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:11.692732 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd0139-0bda-4063-8bc3-e365b60f2f8d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-f3fd0139-0bda-4063-8bc3-e365b60f2f8d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:11.706114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:11.707335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:11.708193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 507/999] 10.222.0.77 () {56 vars in 1126 bytes} [Thu Jun 16 17:18:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:11.708992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5404d5-ea38-4531-be99-cccd49b94453 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:11.708992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5404d5-ea38-4531-be99-cccd49b94453 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:11.709120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5404d5-ea38-4531-be99-cccd49b94453 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:11.712117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 508/1000] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:11.713921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5404d5-ea38-4531-be99-cccd49b94453 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:11.722391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:11.731839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda189ef-c506-474b-a44e-6e73f8c79b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:11.732686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda189ef-c506-474b-a44e-6e73f8c79b61 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:11.732973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda189ef-c506-474b-a44e-6e73f8c79b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:11.733251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda189ef-c506-474b-a44e-6e73f8c79b61 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:11.733902 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda189ef-c506-474b-a44e-6e73f8c79b61 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:11.735276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda189ef-c506-474b-a44e-6e73f8c79b61 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-fda189ef-c506-474b-a44e-6e73f8c79b61 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:11.749364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:11.750443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:11.751366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 493/1001] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:18:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:11.752182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2decb-0865-466c-aa53-bde22f935667 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:11.752182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2decb-0865-466c-aa53-bde22f935667 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:11.752491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2decb-0865-466c-aa53-bde22f935667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:11.769492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5df2decb-0865-466c-aa53-bde22f935667 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:11.770692 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5df2decb-0865-466c-aa53-bde22f935667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:11.821699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5404d5-ea38-4531-be99-cccd49b94453 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:11.838434 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 494/1002] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:11.839302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2decb-0865-466c-aa53-bde22f935667 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:11.862934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724fcc1-dc1e-4d92-936f-815b667e8b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:11.863611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724fcc1-dc1e-4d92-936f-815b667e8b60 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:11.863893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724fcc1-dc1e-4d92-936f-815b667e8b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:11.864204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724fcc1-dc1e-4d92-936f-815b667e8b60 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:11.864906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724fcc1-dc1e-4d92-936f-815b667e8b60 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:11.865213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724fcc1-dc1e-4d92-936f-815b667e8b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:11.866566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724fcc1-dc1e-4d92-936f-815b667e8b60 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:11.872229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 509/1003] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Jun 16 17:18:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:11.874551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724fcc1-dc1e-4d92-936f-815b667e8b60 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:11.919422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:11.942173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2decb-0865-466c-aa53-bde22f935667 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:11.962526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:11.975937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281ae0c-f9de-4b4f-84bc-aa5dd3a2196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:11.976324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724fcc1-dc1e-4d92-936f-815b667e8b60 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:11.976628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281ae0c-f9de-4b4f-84bc-aa5dd3a2196e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:11.977580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281ae0c-f9de-4b4f-84bc-aa5dd3a2196e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:11.977958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281ae0c-f9de-4b4f-84bc-aa5dd3a2196e None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:11.978651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281ae0c-f9de-4b4f-84bc-aa5dd3a2196e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:11.978947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281ae0c-f9de-4b4f-84bc-aa5dd3a2196e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:11.980337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281ae0c-f9de-4b4f-84bc-aa5dd3a2196e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:11.985000 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 495/1004] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:18:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:11.985801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281ae0c-f9de-4b4f-84bc-aa5dd3a2196e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:12.011578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929ac7e-e4a4-4636-8139-47d5e91c0eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:12.012542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929ac7e-e4a4-4636-8139-47d5e91c0eb6 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:12.012825 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929ac7e-e4a4-4636-8139-47d5e91c0eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:12.013104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929ac7e-e4a4-4636-8139-47d5e91c0eb6 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:12.013842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929ac7e-e4a4-4636-8139-47d5e91c0eb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:12.015195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929ac7e-e4a4-4636-8139-47d5e91c0eb6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:12.085889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281ae0c-f9de-4b4f-84bc-aa5dd3a2196e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:12.097597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 510/1005] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:18:11 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:18:12.098537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929ac7e-e4a4-4636-8139-47d5e91c0eb6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:12.134580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05068ea1-5bb7-49f0-a080-9702c82dd67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:12.136321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05068ea1-5bb7-49f0-a080-9702c82dd67b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:12.136800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05068ea1-5bb7-49f0-a080-9702c82dd67b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:12.137538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05068ea1-5bb7-49f0-a080-9702c82dd67b None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:12.138449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05068ea1-5bb7-49f0-a080-9702c82dd67b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:12.139094 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05068ea1-5bb7-49f0-a080-9702c82dd67b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:12.141468 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05068ea1-5bb7-49f0-a080-9702c82dd67b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:12.152172 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 496/1006] 10.222.0.77 () {56 vars in 1122 bytes} [Thu Jun 16 17:18:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:12.153894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05068ea1-5bb7-49f0-a080-9702c82dd67b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:12.207140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:12.228992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929ac7e-e4a4-4636-8139-47d5e91c0eb6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:12.230847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:12.267984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789528b0-1a5d-48ce-ade7-1c4ce938e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:12.268464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05068ea1-5bb7-49f0-a080-9702c82dd67b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:12.269213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789528b0-1a5d-48ce-ade7-1c4ce938e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:12.269528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789528b0-1a5d-48ce-ade7-1c4ce938e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:12.269806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789528b0-1a5d-48ce-ade7-1c4ce938e7a8 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:12.270544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789528b0-1a5d-48ce-ade7-1c4ce938e7a8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:12.270854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789528b0-1a5d-48ce-ade7-1c4ce938e7a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:12.272346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789528b0-1a5d-48ce-ade7-1c4ce938e7a8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:12.277346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 511/1007] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:18:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:12.283705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789528b0-1a5d-48ce-ade7-1c4ce938e7a8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:12.313704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229aaea-120e-46d0-b1fb-4163466220e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:12.314365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229aaea-120e-46d0-b1fb-4163466220e9 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:12.314646 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229aaea-120e-46d0-b1fb-4163466220e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:12.314917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229aaea-120e-46d0-b1fb-4163466220e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:12.315713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229aaea-120e-46d0-b1fb-4163466220e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:12.317113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229aaea-120e-46d0-b1fb-4163466220e9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:12.396472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789528b0-1a5d-48ce-ade7-1c4ce938e7a8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:12.428579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 497/1008] 10.222.0.77 () {60 vars in 1144 bytes} [Thu Jun 16 17:18:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:18:12.437847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40391f9-643e-4fac-b0f9-79f9e560872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:12.438637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40391f9-643e-4fac-b0f9-79f9e560872a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:12.438888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40391f9-643e-4fac-b0f9-79f9e560872a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:12.439161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40391f9-643e-4fac-b0f9-79f9e560872a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:12.439955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40391f9-643e-4fac-b0f9-79f9e560872a None admin] RBAC: Adding query filter params (interface=public, service_id=4ac25cdd9b66418bac53ea3273206541, region_id=RegionOne) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:12.440311 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40391f9-643e-4fac-b0f9-79f9e560872a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:12.441715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40391f9-643e-4fac-b0f9-79f9e560872a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:12.448229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 512/1009] 10.222.0.77 () {56 vars in 1251 bytes} [Thu Jun 16 17:18:12 2022] GET /identity/v3/endpoints?service_id=4ac25cdd9b66418bac53ea3273206541&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:12.454008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229aaea-120e-46d0-b1fb-4163466220e9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:12.570320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229aaea-120e-46d0-b1fb-4163466220e9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:12.577504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:12.612788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb508fc-2032-4c47-a9c2-fd89c4afb863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:12.613466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb508fc-2032-4c47-a9c2-fd89c4afb863 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:12.613856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb508fc-2032-4c47-a9c2-fd89c4afb863 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:12.614133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb508fc-2032-4c47-a9c2-fd89c4afb863 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:12.614811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb508fc-2032-4c47-a9c2-fd89c4afb863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:12.616222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb508fc-2032-4c47-a9c2-fd89c4afb863 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:12.624280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 498/1010] 10.222.0.77 () {56 vars in 1087 bytes} [Thu Jun 16 17:18:12 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:18:14.302483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a204168-42ce-4f58-9de0-0f200e852a5f None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:14.303012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a204168-42ce-4f58-9de0-0f200e852a5f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:14.303012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a204168-42ce-4f58-9de0-0f200e852a5f None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:14.304553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 513/1011] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:14.309802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36847f60-2244-4670-8037-d711205879bd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:14.310262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36847f60-2244-4670-8037-d711205879bd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:14.310348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36847f60-2244-4670-8037-d711205879bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:14.328186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-36847f60-2244-4670-8037-d711205879bd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:14.329383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-36847f60-2244-4670-8037-d711205879bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:14.401699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 499/1012] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:14 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:14.425044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a204168-42ce-4f58-9de0-0f200e852a5f None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:14.454836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:14.530897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a204168-42ce-4f58-9de0-0f200e852a5f None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:14.571038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ae8a-cbd4-49ab-a054-ca224eb64844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:14.572623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ae8a-cbd4-49ab-a054-ca224eb64844 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:14.572770 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ae8a-cbd4-49ab-a054-ca224eb64844 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:14.575164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ae8a-cbd4-49ab-a054-ca224eb64844 None admin] PATH_INFO: `/v3/services/image` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:14.575164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770ae8a-cbd4-49ab-a054-ca224eb64844 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:14.575164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770ae8a-cbd4-49ab-a054-ca224eb64844 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b770ae8a-cbd4-49ab-a054-ca224eb64844 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:14.589437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:14.590511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:18:14.591344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:14.596901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36847f60-2244-4670-8037-d711205879bd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:14.600253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 514/1013] 10.222.0.77 () {56 vars in 1105 bytes} [Thu Jun 16 17:18:14 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:14.649640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373d07d-fc2b-4a68-88ed-904058ac0754 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:14.649967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373d07d-fc2b-4a68-88ed-904058ac0754 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:14.650321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373d07d-fc2b-4a68-88ed-904058ac0754 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:14.651691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 515/1014] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:14.656741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d5291-ee2a-4638-9119-2aa70f08b2be None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:14.657029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d5291-ee2a-4638-9119-2aa70f08b2be None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:14.657312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d5291-ee2a-4638-9119-2aa70f08b2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:14.675237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3c0d5291-ee2a-4638-9119-2aa70f08b2be None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:14.676529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3c0d5291-ee2a-4638-9119-2aa70f08b2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:14.708750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:14.714250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36847f60-2244-4670-8037-d711205879bd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:14.753134 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 516/1015] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:14 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:14.756921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b3fbd-b28b-4614-9350-ca7891bcb64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:14.757596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b3fbd-b28b-4614-9350-ca7891bcb64f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:14.757883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b3fbd-b28b-4614-9350-ca7891bcb64f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:14.758717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b3fbd-b28b-4614-9350-ca7891bcb64f None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:14.759438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b3fbd-b28b-4614-9350-ca7891bcb64f None admin] RBAC: Adding query filter params (name=image) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:14.759751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b3fbd-b28b-4614-9350-ca7891bcb64f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:14.761204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b3fbd-b28b-4614-9350-ca7891bcb64f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:14.771194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 500/1016] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:14.772387 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d5291-ee2a-4638-9119-2aa70f08b2be None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:14.780514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b3fbd-b28b-4614-9350-ca7891bcb64f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:14.795484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:14.873033 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d5291-ee2a-4638-9119-2aa70f08b2be None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:14.884144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b3fbd-b28b-4614-9350-ca7891bcb64f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:14.907293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10156745-940f-470b-be2f-98195c4961c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:14.914074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10156745-940f-470b-be2f-98195c4961c9 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:14.914074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10156745-940f-470b-be2f-98195c4961c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:14.914074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10156745-940f-470b-be2f-98195c4961c9 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:14.914074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10156745-940f-470b-be2f-98195c4961c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:14.914074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10156745-940f-470b-be2f-98195c4961c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:14.914074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10156745-940f-470b-be2f-98195c4961c9 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:14.916383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 517/1017] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:14.917590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717d62d-c1c6-4154-99dc-644b65c17fc2 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:14.917919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717d62d-c1c6-4154-99dc-644b65c17fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:14.918164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717d62d-c1c6-4154-99dc-644b65c17fc2 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:14.919387 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 518/1018] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:14.922369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e8abc-59e4-45b0-ad85-81adbc916061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:14.922509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717d62d-c1c6-4154-99dc-644b65c17fc2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:14.922600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e8abc-59e4-45b0-ad85-81adbc916061 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:14.922600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e8abc-59e4-45b0-ad85-81adbc916061 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:14.922752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e8abc-59e4-45b0-ad85-81adbc916061 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:14.924061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e8abc-59e4-45b0-ad85-81adbc916061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:14.925679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e8abc-59e4-45b0-ad85-81adbc916061 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:14.931101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 501/1019] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:14.931101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ef8e-2185-4cb5-88cd-0c76c29b7fc2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:14.931101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ef8e-2185-4cb5-88cd-0c76c29b7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:14.931101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ef8e-2185-4cb5-88cd-0c76c29b7fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:14.946378 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f026ef8e-2185-4cb5-88cd-0c76c29b7fc2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:14.947581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f026ef8e-2185-4cb5-88cd-0c76c29b7fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:14.971803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:15.012612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:15.030956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 502/1020] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:14 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:15.030956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026ef8e-2185-4cb5-88cd-0c76c29b7fc2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:15.031213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717d62d-c1c6-4154-99dc-644b65c17fc2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:15.063933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ec9d6-574a-4603-8728-b72e5db78dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:15.064616 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ec9d6-574a-4603-8728-b72e5db78dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:15.064990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ec9d6-574a-4603-8728-b72e5db78dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:15.065256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ec9d6-574a-4603-8728-b72e5db78dd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:15.066042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ec9d6-574a-4603-8728-b72e5db78dd6 None admin] RBAC: Adding query filter params (interface=public, service_id=132d5f9ac9db4ee48ce896a17d327e6d, region_id=RegionOne) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:15.066679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ec9d6-574a-4603-8728-b72e5db78dd6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:15.068397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ec9d6-574a-4603-8728-b72e5db78dd6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:15.074827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 519/1021] 10.222.0.77 () {56 vars in 1251 bytes} [Thu Jun 16 17:18:14 2022] GET /identity/v3/endpoints?service_id=132d5f9ac9db4ee48ce896a17d327e6d&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:15.075526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ec9d6-574a-4603-8728-b72e5db78dd6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:15.135669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026ef8e-2185-4cb5-88cd-0c76c29b7fc2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:15.169267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66824e74-03b4-41c9-8441-78b20366de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:15.169927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66824e74-03b4-41c9-8441-78b20366de43 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:15.170207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66824e74-03b4-41c9-8441-78b20366de43 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:15.170481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66824e74-03b4-41c9-8441-78b20366de43 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:15.171169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66824e74-03b4-41c9-8441-78b20366de43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:15.172630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66824e74-03b4-41c9-8441-78b20366de43 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:15.174769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ec9d6-574a-4603-8728-b72e5db78dd6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:15.209258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5cd01-a838-47cc-a9cf-7fccc9af2931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:15.210087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5cd01-a838-47cc-a9cf-7fccc9af2931 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:15.210369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5cd01-a838-47cc-a9cf-7fccc9af2931 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:15.210641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5cd01-a838-47cc-a9cf-7fccc9af2931 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:15.211937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5cd01-a838-47cc-a9cf-7fccc9af2931 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:15.213355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5cd01-a838-47cc-a9cf-7fccc9af2931 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b4c5cd01-a838-47cc-a9cf-7fccc9af2931 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:15.224898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:15.226080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:15.227509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 520/1022] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:18:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:15.228630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5cd01-a838-47cc-a9cf-7fccc9af2931 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:15.243298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:15.273824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 503/1023] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:18:15 2022] POST /identity/v3/projects => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:18:15.274853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66824e74-03b4-41c9-8441-78b20366de43 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:15.302152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:15.338050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5cd01-a838-47cc-a9cf-7fccc9af2931 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:15.377834 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062259d-659e-42eb-afea-a1c2fd1af27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:15.378636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062259d-659e-42eb-afea-a1c2fd1af27b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:15.378928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062259d-659e-42eb-afea-a1c2fd1af27b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:15.379262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062259d-659e-42eb-afea-a1c2fd1af27b None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:15.379900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062259d-659e-42eb-afea-a1c2fd1af27b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:15.381339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062259d-659e-42eb-afea-a1c2fd1af27b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:15.400195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 521/1024] 10.222.0.77 () {56 vars in 1087 bytes} [Thu Jun 16 17:18:15 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:18:15.412292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66824e74-03b4-41c9-8441-78b20366de43 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:15.456196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9dd25-b35c-499a-91b1-4a33dc4666a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:15.456904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9dd25-b35c-499a-91b1-4a33dc4666a6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:15.457189 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9dd25-b35c-499a-91b1-4a33dc4666a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:15.457468 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9dd25-b35c-499a-91b1-4a33dc4666a6 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:15.458184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9dd25-b35c-499a-91b1-4a33dc4666a6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:15.458504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9dd25-b35c-499a-91b1-4a33dc4666a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:15.459882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9dd25-b35c-499a-91b1-4a33dc4666a6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:15.467483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 504/1025] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:18:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:15.473535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062259d-659e-42eb-afea-a1c2fd1af27b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:15.567909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:15.595772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062259d-659e-42eb-afea-a1c2fd1af27b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:15.632642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c378238-f361-4e05-a6db-0243490666b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:15.633672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378238-f361-4e05-a6db-0243490666b8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:15.634146 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378238-f361-4e05-a6db-0243490666b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:15.634610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378238-f361-4e05-a6db-0243490666b8 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:15.635506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c378238-f361-4e05-a6db-0243490666b8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:15.636010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c378238-f361-4e05-a6db-0243490666b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:15.637847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c378238-f361-4e05-a6db-0243490666b8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:15.647978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 522/1026] 10.222.0.77 () {56 vars in 1112 bytes} [Thu Jun 16 17:18:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:15.650337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9dd25-b35c-499a-91b1-4a33dc4666a6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:15.734831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:15.759230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9dd25-b35c-499a-91b1-4a33dc4666a6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:15.795998 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f9612-86bc-47c6-ad71-4afe9aada231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:15.796710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f9612-86bc-47c6-ad71-4afe9aada231 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:15.797019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f9612-86bc-47c6-ad71-4afe9aada231 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:15.797313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f9612-86bc-47c6-ad71-4afe9aada231 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:15.798077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f9612-86bc-47c6-ad71-4afe9aada231 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:15.799457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f9612-86bc-47c6-ad71-4afe9aada231 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:15.923169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 505/1027] 10.222.0.77 () {60 vars in 1144 bytes} [Thu Jun 16 17:18:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:18:17.515153 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc2a69-9213-4d5d-ac6e-dc1b736cbb11 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:17.515783 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc2a69-9213-4d5d-ac6e-dc1b736cbb11 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:17.515783 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc2a69-9213-4d5d-ac6e-dc1b736cbb11 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:17.517293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 523/1028] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:17.522397 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4880b5f-2ef0-4130-91cd-d2f26af9fa89 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:17.522813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4880b5f-2ef0-4130-91cd-d2f26af9fa89 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:17.522983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4880b5f-2ef0-4130-91cd-d2f26af9fa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:17.540346 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a4880b5f-2ef0-4130-91cd-d2f26af9fa89 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:17.541540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a4880b5f-2ef0-4130-91cd-d2f26af9fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:17.551362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a471a2-6abe-4884-9f35-a31eb0447cf3 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:17.551640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a471a2-6abe-4884-9f35-a31eb0447cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:17.551919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a471a2-6abe-4884-9f35-a31eb0447cf3 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:17.553306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 524/1029] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:17.558430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef191741-8c4a-4747-8750-79258124d44c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:17.558717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef191741-8c4a-4747-8750-79258124d44c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:17.559013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef191741-8c4a-4747-8750-79258124d44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:17.576270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ef191741-8c4a-4747-8750-79258124d44c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:17.577444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ef191741-8c4a-4747-8750-79258124d44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:17.626962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 506/1030] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:17.648813 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 525/1031] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:17.651580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4880b5f-2ef0-4130-91cd-d2f26af9fa89 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:17.672391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef191741-8c4a-4747-8750-79258124d44c None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:17.712491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:17.745417 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:17.759923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4880b5f-2ef0-4130-91cd-d2f26af9fa89 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:17.776352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef191741-8c4a-4747-8750-79258124d44c None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:17.797201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68898-fcb0-49e7-aedc-d6b7f7b23832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:17.800736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68898-fcb0-49e7-aedc-d6b7f7b23832 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:17.800736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68898-fcb0-49e7-aedc-d6b7f7b23832 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:17.800736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68898-fcb0-49e7-aedc-d6b7f7b23832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:17.800736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c68898-fcb0-49e7-aedc-d6b7f7b23832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:17.801196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c68898-fcb0-49e7-aedc-d6b7f7b23832 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:17.802946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 507/1032] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:17.808945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68898-fcb0-49e7-aedc-d6b7f7b23832 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:17.813174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a5d8-a59e-4c65-a629-82e3b4cab259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:17.813970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a5d8-a59e-4c65-a629-82e3b4cab259 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:17.814250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a5d8-a59e-4c65-a629-82e3b4cab259 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:17.814523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a5d8-a59e-4c65-a629-82e3b4cab259 None admin] PATH_INFO: `/v3/services/image` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:17.815173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690a5d8-a59e-4c65-a629-82e3b4cab259 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:17.816679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690a5d8-a59e-4c65-a629-82e3b4cab259 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-3690a5d8-a59e-4c65-a629-82e3b4cab259 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:17.828389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:17.829458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:17.830347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 526/1033] 10.222.0.77 () {56 vars in 1105 bytes} [Thu Jun 16 17:18:17 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:17.835292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a5d8-a59e-4c65-a629-82e3b4cab259 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:17.914943 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68898-fcb0-49e7-aedc-d6b7f7b23832 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:17.938743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a5d8-a59e-4c65-a629-82e3b4cab259 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:17.941668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:17.955007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b9606-671e-42cc-b5f6-7cff805626ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:17.955736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9606-671e-42cc-b5f6-7cff805626ca None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:17.956018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9606-671e-42cc-b5f6-7cff805626ca None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:17.956314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9606-671e-42cc-b5f6-7cff805626ca None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:17.957028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b9606-671e-42cc-b5f6-7cff805626ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:17.958450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b9606-671e-42cc-b5f6-7cff805626ca None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:17.975044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2284a7-26cc-4747-958c-6cb3e4043dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:17.975718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2284a7-26cc-4747-958c-6cb3e4043dcb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:17.976004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2284a7-26cc-4747-958c-6cb3e4043dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:17.983853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2284a7-26cc-4747-958c-6cb3e4043dcb None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:17.983853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2284a7-26cc-4747-958c-6cb3e4043dcb None admin] RBAC: Adding query filter params (name=image) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:17.983853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2284a7-26cc-4747-958c-6cb3e4043dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:17.983853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2284a7-26cc-4747-958c-6cb3e4043dcb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:17.983853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:17.984653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 527/1034] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:17.990166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2284a7-26cc-4747-958c-6cb3e4043dcb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:18.053095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 508/1035] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:18:17 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:18:18.111560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2284a7-26cc-4747-958c-6cb3e4043dcb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:18.149440 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6ede6-95c5-40bd-b466-d680b4b7a7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:18.150133 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ede6-95c5-40bd-b466-d680b4b7a7fa None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:18.150420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ede6-95c5-40bd-b466-d680b4b7a7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:18.150699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6ede6-95c5-40bd-b466-d680b4b7a7fa None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:18.151416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6ede6-95c5-40bd-b466-d680b4b7a7fa None admin] RBAC: Adding query filter params (type=image) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:18.151727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6ede6-95c5-40bd-b466-d680b4b7a7fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:18.153180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6ede6-95c5-40bd-b466-d680b4b7a7fa None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:18.159135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e321f-98bc-4ced-8a7f-96be00d24634 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:18.159334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 528/1036] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:18.159969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e321f-98bc-4ced-8a7f-96be00d24634 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:18.161828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e321f-98bc-4ced-8a7f-96be00d24634 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:18.163604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 509/1037] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:18.165113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6ede6-95c5-40bd-b466-d680b4b7a7fa None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:18.169792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16b707-0fe5-45fd-999d-5878315a5529 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:18.170078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16b707-0fe5-45fd-999d-5878315a5529 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:18.170358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16b707-0fe5-45fd-999d-5878315a5529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:18.188629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-db16b707-0fe5-45fd-999d-5878315a5529 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:18.189873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-db16b707-0fe5-45fd-999d-5878315a5529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:18.243896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:18.270023 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 510/1038] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:18.286281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6ede6-95c5-40bd-b466-d680b4b7a7fa None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:18.294373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16b707-0fe5-45fd-999d-5878315a5529 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:18.330551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503f2e5-7a17-4a4d-a7de-cd10c871bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:18.331136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503f2e5-7a17-4a4d-a7de-cd10c871bcd3 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:18.331416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503f2e5-7a17-4a4d-a7de-cd10c871bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:18.331689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503f2e5-7a17-4a4d-a7de-cd10c871bcd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:18.332520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503f2e5-7a17-4a4d-a7de-cd10c871bcd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:18.333884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503f2e5-7a17-4a4d-a7de-cd10c871bcd3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:18.404234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16b707-0fe5-45fd-999d-5878315a5529 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:18.417440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:18.438009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b25b4a-e4c0-428f-92f9-73d485fe1260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:18.438905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b25b4a-e4c0-428f-92f9-73d485fe1260 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:18.439185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b25b4a-e4c0-428f-92f9-73d485fe1260 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:18.439462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b25b4a-e4c0-428f-92f9-73d485fe1260 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:18.450054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b25b4a-e4c0-428f-92f9-73d485fe1260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-68b25b4a-e4c0-428f-92f9-73d485fe1260 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:18:18.458264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:18.459220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:18.460152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 511/1039] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Jun 16 17:18:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:18.465627 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b25b4a-e4c0-428f-92f9-73d485fe1260 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:18.476243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 529/1040] 10.222.0.77 () {60 vars in 1144 bytes} [Thu Jun 16 17:18:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:18:18.590642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b25b4a-e4c0-428f-92f9-73d485fe1260 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:18.638369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cc8ee-c100-4160-b11e-6c66c925c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:18.639556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cc8ee-c100-4160-b11e-6c66c925c979 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:18.639556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cc8ee-c100-4160-b11e-6c66c925c979 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:18.639556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cc8ee-c100-4160-b11e-6c66c925c979 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:18.643908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cc8ee-c100-4160-b11e-6c66c925c979 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:18.643908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cc8ee-c100-4160-b11e-6c66c925c979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:18.643908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cc8ee-c100-4160-b11e-6c66c925c979 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:18.660782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 512/1041] 10.222.0.77 () {56 vars in 1115 bytes} [Thu Jun 16 17:18:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:18.671097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503f2e5-7a17-4a4d-a7de-cd10c871bcd3 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:18.774904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503f2e5-7a17-4a4d-a7de-cd10c871bcd3 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:18.793050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:18.810978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784bde9-c9aa-4d68-9293-ba2e2af72f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:18.811890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784bde9-c9aa-4d68-9293-ba2e2af72f6f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:18.812308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784bde9-c9aa-4d68-9293-ba2e2af72f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:18.812612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784bde9-c9aa-4d68-9293-ba2e2af72f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:18.823116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784bde9-c9aa-4d68-9293-ba2e2af72f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:18.824612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784bde9-c9aa-4d68-9293-ba2e2af72f6f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-0784bde9-c9aa-4d68-9293-ba2e2af72f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:18.843459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:18.844774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:18.845715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:18:18.845715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:18.845715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:18.845715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:18.846965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 530/1042] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:18.848993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cc8ee-c100-4160-b11e-6c66c925c979 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:18.881641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:18.953663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cc8ee-c100-4160-b11e-6c66c925c979 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:18.988049 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d51da-6274-4623-b3c0-e31cd9d18cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:18.988741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d51da-6274-4623-b3c0-e31cd9d18cce None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:18.989023 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d51da-6274-4623-b3c0-e31cd9d18cce None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:18.989296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d51da-6274-4623-b3c0-e31cd9d18cce None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:18.990005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d51da-6274-4623-b3c0-e31cd9d18cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:18.990313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d51da-6274-4623-b3c0-e31cd9d18cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:18.991680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d51da-6274-4623-b3c0-e31cd9d18cce None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:19.006853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 513/1043] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:19.013294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784bde9-c9aa-4d68-9293-ba2e2af72f6f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:19.116180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784bde9-c9aa-4d68-9293-ba2e2af72f6f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:19.150896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c029b-e12d-4d62-af1c-85c5084fdd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:19.151696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c029b-e12d-4d62-af1c-85c5084fdd93 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:19.151982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c029b-e12d-4d62-af1c-85c5084fdd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:19.152285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c029b-e12d-4d62-af1c-85c5084fdd93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:19.159857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c029b-e12d-4d62-af1c-85c5084fdd93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:19.161318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c029b-e12d-4d62-af1c-85c5084fdd93 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b02c029b-e12d-4d62-af1c-85c5084fdd93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:18:19.175237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:19.176493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:19.177502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:19.177502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:19.177502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:18:19.177502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:18:19.177502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:18:19.177502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:18:19.177502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:18:19.177502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:18:19.177502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:18:19.177502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:19.181008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 531/1044] 10.222.0.77 () {56 vars in 1093 bytes} [Thu Jun 16 17:18:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:19.182822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d51da-6274-4623-b3c0-e31cd9d18cce None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:19.282883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:19.294002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d51da-6274-4623-b3c0-e31cd9d18cce None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:19.331751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f937975-b16a-4ab6-8994-5c5e846c52e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:19.332526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f937975-b16a-4ab6-8994-5c5e846c52e8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:19.332811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f937975-b16a-4ab6-8994-5c5e846c52e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:19.333089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f937975-b16a-4ab6-8994-5c5e846c52e8 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:19.333917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f937975-b16a-4ab6-8994-5c5e846c52e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:19.334229 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f937975-b16a-4ab6-8994-5c5e846c52e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:19.335709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f937975-b16a-4ab6-8994-5c5e846c52e8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:19.359879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 514/1045] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Jun 16 17:18:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:19.361133 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c029b-e12d-4d62-af1c-85c5084fdd93 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:19.395273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:19.466667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c029b-e12d-4d62-af1c-85c5084fdd93 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:19.500292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dbb0c-dc02-403e-8358-d1d3601c7bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:19.500941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbb0c-dc02-403e-8358-d1d3601c7bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:19.501221 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbb0c-dc02-403e-8358-d1d3601c7bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:19.501495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbb0c-dc02-403e-8358-d1d3601c7bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:19.577105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dbb0c-dc02-403e-8358-d1d3601c7bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:19.578561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dbb0c-dc02-403e-8358-d1d3601c7bc9 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:19.610471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:19.687005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 532/1046] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 17:18:19.688940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f937975-b16a-4ab6-8994-5c5e846c52e8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:19.790257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f937975-b16a-4ab6-8994-5c5e846c52e8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:19.824751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebe047-eda5-4f60-b48b-08548d7129e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:19.825566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebe047-eda5-4f60-b48b-08548d7129e1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:19.825837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebe047-eda5-4f60-b48b-08548d7129e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:19.826111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebe047-eda5-4f60-b48b-08548d7129e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:19.836624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebe047-eda5-4f60-b48b-08548d7129e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:19.838150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebe047-eda5-4f60-b48b-08548d7129e1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:19.846659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-acebe047-eda5-4f60-b48b-08548d7129e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:19.856981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:19.861933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:19.862836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:18:19.862836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:19.862836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:19.862836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:19.862836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 515/1047] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:19.863800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dbb0c-dc02-403e-8358-d1d3601c7bc9 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:19.964930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dbb0c-dc02-403e-8358-d1d3601c7bc9 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:19.993713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:19.999935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b712f8-eecd-4a79-89cc-c8fa5ce6af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:20.000634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b712f8-eecd-4a79-89cc-c8fa5ce6af58 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.000918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b712f8-eecd-4a79-89cc-c8fa5ce6af58 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.001193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b712f8-eecd-4a79-89cc-c8fa5ce6af58 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.001909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b712f8-eecd-4a79-89cc-c8fa5ce6af58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:20.002214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b712f8-eecd-4a79-89cc-c8fa5ce6af58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:20.003570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b712f8-eecd-4a79-89cc-c8fa5ce6af58 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:20.019610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 533/1048] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:20.021175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebe047-eda5-4f60-b48b-08548d7129e1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:20.123622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebe047-eda5-4f60-b48b-08548d7129e1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:20.158976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488778df-90f1-4e75-a8ca-30e4ca8f66ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:20.159779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488778df-90f1-4e75-a8ca-30e4ca8f66ee None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.160061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488778df-90f1-4e75-a8ca-30e4ca8f66ee None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.160406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488778df-90f1-4e75-a8ca-30e4ca8f66ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.167912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488778df-90f1-4e75-a8ca-30e4ca8f66ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:20.169388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488778df-90f1-4e75-a8ca-30e4ca8f66ee None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-488778df-90f1-4e75-a8ca-30e4ca8f66ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:18:20.183320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:20.189510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:20.190500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:18:20.190500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:18:20.190500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:18:20.190500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:18:20.190500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:18:20.190500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:18:20.190500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:20.190500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:20.190500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 516/1049] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:20.191037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b712f8-eecd-4a79-89cc-c8fa5ce6af58 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:20.298302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b712f8-eecd-4a79-89cc-c8fa5ce6af58 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:20.324995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c12fc-6f7e-472e-8ea4-d7b5311aa9ee None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.325278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c12fc-6f7e-472e-8ea4-d7b5311aa9ee None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.325559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c12fc-6f7e-472e-8ea4-d7b5311aa9ee None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.327041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 517/1050] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:20.331773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7a220-e071-41b5-ab65-49a95f281d8d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.332060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7a220-e071-41b5-ab65-49a95f281d8d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.332371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7a220-e071-41b5-ab65-49a95f281d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.334333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0fb7b-d805-43be-8cdf-f2726609853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:20.335058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0fb7b-d805-43be-8cdf-f2726609853f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.335412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0fb7b-d805-43be-8cdf-f2726609853f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.335759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0fb7b-d805-43be-8cdf-f2726609853f None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.337192 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0fb7b-d805-43be-8cdf-f2726609853f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:20.337611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0fb7b-d805-43be-8cdf-f2726609853f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:20.339122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0fb7b-d805-43be-8cdf-f2726609853f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:20.350856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5da7a220-e071-41b5-ab65-49a95f281d8d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:20.353084 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5da7a220-e071-41b5-ab65-49a95f281d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:20.358129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 534/1051] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:20.359189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0fb7b-d805-43be-8cdf-f2726609853f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:20.418347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:20.422112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:20.433409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 518/1052] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:20.457410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7a220-e071-41b5-ab65-49a95f281d8d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:20.477298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0fb7b-d805-43be-8cdf-f2726609853f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:20.514878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268e660-ced2-4929-af51-4cb59dea7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:20.515535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268e660-ced2-4929-af51-4cb59dea7295 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.515818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268e660-ced2-4929-af51-4cb59dea7295 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.516116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268e660-ced2-4929-af51-4cb59dea7295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.517209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268e660-ced2-4929-af51-4cb59dea7295 None admin] RBAC: Adding query filter params (role.id=288469399b864e5fa238342d9301217b, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=ba0bb071b7c04e1da55259f079a9c805) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:20.517209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268e660-ced2-4929-af51-4cb59dea7295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:20.518650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268e660-ced2-4929-af51-4cb59dea7295 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:20.524956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 535/1053] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:18:20 2022] GET /identity/v3/role_assignments?user.id=ba0bb071b7c04e1da55259f079a9c805&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=288469399b864e5fa238342d9301217b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:20.595079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7a220-e071-41b5-ab65-49a95f281d8d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:20.635826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523cb66-fb3b-4617-b58c-d126a883740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:20.636934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523cb66-fb3b-4617-b58c-d126a883740b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.637215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523cb66-fb3b-4617-b58c-d126a883740b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.637488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523cb66-fb3b-4617-b58c-d126a883740b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.649711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523cb66-fb3b-4617-b58c-d126a883740b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-1523cb66-fb3b-4617-b58c-d126a883740b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:18:20.657555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:20.658683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:20.659513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:20.663928 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 519/1054] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:18:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:20.665422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268e660-ced2-4929-af51-4cb59dea7295 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:20.666317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ecaa9-833d-4723-934f-7f2c23c1f864 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.666608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ecaa9-833d-4723-934f-7f2c23c1f864 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.666887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ecaa9-833d-4723-934f-7f2c23c1f864 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.668287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 520/1055] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:20.673823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243db5-7755-49a0-88ae-7f9523ad010f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.674107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243db5-7755-49a0-88ae-7f9523ad010f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.674389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243db5-7755-49a0-88ae-7f9523ad010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.693364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0f243db5-7755-49a0-88ae-7f9523ad010f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:20.694558 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0f243db5-7755-49a0-88ae-7f9523ad010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:20.747472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:20.769162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 521/1056] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:20.779766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268e660-ced2-4929-af51-4cb59dea7295 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:20.793043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f243db5-7755-49a0-88ae-7f9523ad010f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:20.795829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:20.817948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d8fed-d007-47a3-8c99-c7b19e37481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:20.818618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d8fed-d007-47a3-8c99-c7b19e37481c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.818896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d8fed-d007-47a3-8c99-c7b19e37481c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.819169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d8fed-d007-47a3-8c99-c7b19e37481c None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.819914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d8fed-d007-47a3-8c99-c7b19e37481c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:20.820407 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d8fed-d007-47a3-8c99-c7b19e37481c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:20.821858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d8fed-d007-47a3-8c99-c7b19e37481c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:20.837281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 536/1057] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:18:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:20.838713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d8fed-d007-47a3-8c99-c7b19e37481c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:20.915423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f243db5-7755-49a0-88ae-7f9523ad010f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:20.967720 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290c3f1-94e1-417e-82f0-358ed970dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:20.968411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290c3f1-94e1-417e-82f0-358ed970dd59 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:20.968697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290c3f1-94e1-417e-82f0-358ed970dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:20.968969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290c3f1-94e1-417e-82f0-358ed970dd59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:20.980326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d8fed-d007-47a3-8c99-c7b19e37481c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:21.017959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c8b43-be30-44d6-877b-59905e3ce1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:21.019097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c8b43-be30-44d6-877b-59905e3ce1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:21.019521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c8b43-be30-44d6-877b-59905e3ce1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:21.019952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c8b43-be30-44d6-877b-59905e3ce1f6 None admin] PATH_INFO: `/v3/users/bd9cd5b7f51943d2a5e7a3b257d7be37` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:21.020662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:21.035510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c8b43-be30-44d6-877b-59905e3ce1f6 None admin] RBAC: Authorizing `identity:get_user(user_id=bd9cd5b7f51943d2a5e7a3b257d7be37)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:21.036985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c8b43-be30-44d6-877b-59905e3ce1f6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:21.039830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 537/1058] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:20 2022] GET /identity/v3/users/bd9cd5b7f51943d2a5e7a3b257d7be37 => generated 285 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:21.041786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290c3f1-94e1-417e-82f0-358ed970dd59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:21.043337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290c3f1-94e1-417e-82f0-358ed970dd59 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:21.045279 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c8b43-be30-44d6-877b-59905e3ce1f6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:21.081251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:21.150544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c8b43-be30-44d6-877b-59905e3ce1f6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:21.158788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 522/1059] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 17:18:21.165605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290c3f1-94e1-417e-82f0-358ed970dd59 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:21.189916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd10208-b1d8-4e38-b68d-4cd4689ebf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:21.190562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd10208-b1d8-4e38-b68d-4cd4689ebf1d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:21.190902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd10208-b1d8-4e38-b68d-4cd4689ebf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:21.191176 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd10208-b1d8-4e38-b68d-4cd4689ebf1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:21.256170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:21.260643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd10208-b1d8-4e38-b68d-4cd4689ebf1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:21.262356 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd10208-b1d8-4e38-b68d-4cd4689ebf1d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:21.279317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290c3f1-94e1-417e-82f0-358ed970dd59 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:21.302603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:21.315638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d6470-09c5-4526-b578-595739a894ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:21.316479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6470-09c5-4526-b578-595739a894ba None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:21.326314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6470-09c5-4526-b578-595739a894ba None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:21.326314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6470-09c5-4526-b578-595739a894ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:21.329688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d6470-09c5-4526-b578-595739a894ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:21.331202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d6470-09c5-4526-b578-595739a894ba None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-036d6470-09c5-4526-b578-595739a894ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:21.350518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:21.352184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:21.353194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:18:21.353194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:21.353194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:21.353194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:21.353194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 523/1060] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:21.358522 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d6470-09c5-4526-b578-595739a894ba None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:21.383478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 538/1061] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 17:18:21.389152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd10208-b1d8-4e38-b68d-4cd4689ebf1d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:21.464012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d6470-09c5-4526-b578-595739a894ba None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:21.494494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd10208-b1d8-4e38-b68d-4cd4689ebf1d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:21.494963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:21.500932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b154149-e608-43ea-a88d-5e0fc0128a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:21.501600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b154149-e608-43ea-a88d-5e0fc0128a4e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:21.501885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b154149-e608-43ea-a88d-5e0fc0128a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:21.502570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b154149-e608-43ea-a88d-5e0fc0128a4e None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:21.503289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b154149-e608-43ea-a88d-5e0fc0128a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:21.503632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b154149-e608-43ea-a88d-5e0fc0128a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:21.505364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b154149-e608-43ea-a88d-5e0fc0128a4e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:21.517072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 524/1062] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:21.532235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05337652-ce3f-4c18-ad1a-49902b95d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:21.533429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05337652-ce3f-4c18-ad1a-49902b95d819 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:21.533865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05337652-ce3f-4c18-ad1a-49902b95d819 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:21.534300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05337652-ce3f-4c18-ad1a-49902b95d819 None admin] PATH_INFO: `/v3/projects/d14f674c3388406d870f8c75038d5551` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:21.535805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05337652-ce3f-4c18-ad1a-49902b95d819 None admin] RBAC: Authorizing `identity:get_project(project_id=d14f674c3388406d870f8c75038d5551)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:21.537529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05337652-ce3f-4c18-ad1a-49902b95d819 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:21.539990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 539/1063] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:18:21 2022] GET /identity/v3/projects/d14f674c3388406d870f8c75038d5551 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:21.545858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b154149-e608-43ea-a88d-5e0fc0128a4e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:21.664784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b154149-e608-43ea-a88d-5e0fc0128a4e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:21.703304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb772620-63ed-40f2-af89-61c783f1d17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:21.704032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb772620-63ed-40f2-af89-61c783f1d17d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:21.704283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb772620-63ed-40f2-af89-61c783f1d17d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:21.704560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb772620-63ed-40f2-af89-61c783f1d17d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:21.705379 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb772620-63ed-40f2-af89-61c783f1d17d None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=d14f674c3388406d870f8c75038d5551, user.id=bd9cd5b7f51943d2a5e7a3b257d7be37) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:21.705696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb772620-63ed-40f2-af89-61c783f1d17d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:21.707125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb772620-63ed-40f2-af89-61c783f1d17d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:21.713569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 525/1064] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:18:21 2022] GET /identity/v3/role_assignments?user.id=bd9cd5b7f51943d2a5e7a3b257d7be37&scope.project.id=d14f674c3388406d870f8c75038d5551&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:22.702385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c33ae-dcca-427a-970d-cfabd423eb87 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:22.702934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c33ae-dcca-427a-970d-cfabd423eb87 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:22.702934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c33ae-dcca-427a-970d-cfabd423eb87 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:22.704388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 540/1065] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:22.709796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e463ab-ea0a-4f3d-b326-38a5653972bd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:22.710199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e463ab-ea0a-4f3d-b326-38a5653972bd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:22.710359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e463ab-ea0a-4f3d-b326-38a5653972bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:22.727620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-81e463ab-ea0a-4f3d-b326-38a5653972bd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:22.728834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-81e463ab-ea0a-4f3d-b326-38a5653972bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:22.779177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:22.797224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 526/1066] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:22.819982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c33ae-dcca-427a-970d-cfabd423eb87 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:22.823800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:22.923685 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c33ae-dcca-427a-970d-cfabd423eb87 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:22.957682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01688be4-65f3-45bb-98e1-ff64e72d2c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:22.958493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01688be4-65f3-45bb-98e1-ff64e72d2c21 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:22.958777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01688be4-65f3-45bb-98e1-ff64e72d2c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:22.959055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01688be4-65f3-45bb-98e1-ff64e72d2c21 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:22.969447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01688be4-65f3-45bb-98e1-ff64e72d2c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-01688be4-65f3-45bb-98e1-ff64e72d2c21 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:18:22.977905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:22.978929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:22.979847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 541/1067] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Jun 16 17:18:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:22.985337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e463ab-ea0a-4f3d-b326-38a5653972bd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:23.081954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e463ab-ea0a-4f3d-b326-38a5653972bd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:23.115773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54662223-2b8a-4b58-90f3-486d88ccfe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:23.116476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54662223-2b8a-4b58-90f3-486d88ccfe2a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:23.116761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54662223-2b8a-4b58-90f3-486d88ccfe2a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:23.117061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54662223-2b8a-4b58-90f3-486d88ccfe2a None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:23.117797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54662223-2b8a-4b58-90f3-486d88ccfe2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:23.118104 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54662223-2b8a-4b58-90f3-486d88ccfe2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:23.119463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54662223-2b8a-4b58-90f3-486d88ccfe2a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:23.128455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 527/1068] 10.222.0.77 () {56 vars in 1115 bytes} [Thu Jun 16 17:18:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:23.134427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01688be4-65f3-45bb-98e1-ff64e72d2c21 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:23.194326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:23.232096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01688be4-65f3-45bb-98e1-ff64e72d2c21 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:23.264957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81137-bdc5-427e-b6bc-517b831c567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:23.265743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81137-bdc5-427e-b6bc-517b831c567b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:23.266022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81137-bdc5-427e-b6bc-517b831c567b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:23.266295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81137-bdc5-427e-b6bc-517b831c567b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:23.277108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b81137-bdc5-427e-b6bc-517b831c567b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:23.278533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b81137-bdc5-427e-b6bc-517b831c567b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-79b81137-bdc5-427e-b6bc-517b831c567b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:23.295793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:23.296972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:23.298280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:18:23.298280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:23.298280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:23.298280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:23.298280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 542/1069] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:23.302702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54662223-2b8a-4b58-90f3-486d88ccfe2a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:23.352052 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:23.404211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54662223-2b8a-4b58-90f3-486d88ccfe2a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:23.437335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddc43b-570d-4493-8910-5bf4574b7698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:23.437992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddc43b-570d-4493-8910-5bf4574b7698 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:23.438275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddc43b-570d-4493-8910-5bf4574b7698 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:23.438542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddc43b-570d-4493-8910-5bf4574b7698 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:23.439243 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddc43b-570d-4493-8910-5bf4574b7698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:23.439547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddc43b-570d-4493-8910-5bf4574b7698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:23.440942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddc43b-570d-4493-8910-5bf4574b7698 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:23.453768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 528/1070] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:23.459426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81137-bdc5-427e-b6bc-517b831c567b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:23.579703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81137-bdc5-427e-b6bc-517b831c567b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:23.594254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:23.614576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63155e-94ff-4baa-b602-a7e3f71b33c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:23.615370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63155e-94ff-4baa-b602-a7e3f71b33c5 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:23.615684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63155e-94ff-4baa-b602-a7e3f71b33c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:23.615929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63155e-94ff-4baa-b602-a7e3f71b33c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:23.624059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63155e-94ff-4baa-b602-a7e3f71b33c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:23.625566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63155e-94ff-4baa-b602-a7e3f71b33c5 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-ad63155e-94ff-4baa-b602-a7e3f71b33c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:18:23.641024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:23.641952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:23.643344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 543/1071] 10.222.0.77 () {56 vars in 1093 bytes} [Thu Jun 16 17:18:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:23.648066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddc43b-570d-4493-8910-5bf4574b7698 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:23.752342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddc43b-570d-4493-8910-5bf4574b7698 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:23.762505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:23.790822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e402a-f707-4014-8311-99412f78155a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:23.791525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e402a-f707-4014-8311-99412f78155a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:23.791814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e402a-f707-4014-8311-99412f78155a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:23.792116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e402a-f707-4014-8311-99412f78155a None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:23.793025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e402a-f707-4014-8311-99412f78155a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:23.793336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e402a-f707-4014-8311-99412f78155a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:23.794813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e402a-f707-4014-8311-99412f78155a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:23.815451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 529/1072] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Jun 16 17:18:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:23.821126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63155e-94ff-4baa-b602-a7e3f71b33c5 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:23.846405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714da99-0555-4a1d-aedc-11d25cd7b952 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:23.846722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714da99-0555-4a1d-aedc-11d25cd7b952 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:23.847003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714da99-0555-4a1d-aedc-11d25cd7b952 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:23.848466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 530/1073] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:23.855346 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03caf-47b4-4ecf-b576-30bfd6c31dfe None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:23.855630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03caf-47b4-4ecf-b576-30bfd6c31dfe None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:23.855902 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03caf-47b4-4ecf-b576-30bfd6c31dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:23.872958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-efe03caf-47b4-4ecf-b576-30bfd6c31dfe None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:23.874160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-efe03caf-47b4-4ecf-b576-30bfd6c31dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:23.936982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63155e-94ff-4baa-b602-a7e3f71b33c5 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:23.945066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 531/1074] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:23.967160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe03caf-47b4-4ecf-b576-30bfd6c31dfe None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:23.970215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe0156-8ae7-41a6-90e1-e88e4c290e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:23.971006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe0156-8ae7-41a6-90e1-e88e4c290e84 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:23.971285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe0156-8ae7-41a6-90e1-e88e4c290e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:23.971555 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe0156-8ae7-41a6-90e1-e88e4c290e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:23.982658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe0156-8ae7-41a6-90e1-e88e4c290e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:23.984107 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe0156-8ae7-41a6-90e1-e88e4c290e84 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-6efe0156-8ae7-41a6-90e1-e88e4c290e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:24.000798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:24.001728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:24.002675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:18:24.002675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:24.002675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:24.002675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:24.002675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 544/1075] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:24.007610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe0156-8ae7-41a6-90e1-e88e4c290e84 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:24.034976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:24.060739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:24.066567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe03caf-47b4-4ecf-b576-30bfd6c31dfe None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:24.099992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fe334-9d16-4634-88ac-88bb90ad520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:24.107135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fe334-9d16-4634-88ac-88bb90ad520b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:24.107135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fe334-9d16-4634-88ac-88bb90ad520b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:24.107135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fe334-9d16-4634-88ac-88bb90ad520b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:24.108276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe0156-8ae7-41a6-90e1-e88e4c290e84 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:24.112694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fe334-9d16-4634-88ac-88bb90ad520b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b26fe334-9d16-4634-88ac-88bb90ad520b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:18:24.121066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:24.122045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:24.122967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 532/1076] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:18:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:24.128516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fe334-9d16-4634-88ac-88bb90ad520b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:24.144474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742037b7-bbc9-46ac-9d43-6c74fdfa6e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:24.145146 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742037b7-bbc9-46ac-9d43-6c74fdfa6e0e None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:24.145435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742037b7-bbc9-46ac-9d43-6c74fdfa6e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:24.145716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742037b7-bbc9-46ac-9d43-6c74fdfa6e0e None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:24.146426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742037b7-bbc9-46ac-9d43-6c74fdfa6e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:24.146735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742037b7-bbc9-46ac-9d43-6c74fdfa6e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:24.148194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742037b7-bbc9-46ac-9d43-6c74fdfa6e0e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:24.159804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 545/1077] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:24.166071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742037b7-bbc9-46ac-9d43-6c74fdfa6e0e None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:24.229088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fe334-9d16-4634-88ac-88bb90ad520b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:24.251873 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:24.272960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742037b7-bbc9-46ac-9d43-6c74fdfa6e0e None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:24.273256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cd650-d7bb-4897-83bf-b90dcd4fddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:24.273256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cd650-d7bb-4897-83bf-b90dcd4fddc3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:24.273732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cd650-d7bb-4897-83bf-b90dcd4fddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:24.274017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cd650-d7bb-4897-83bf-b90dcd4fddc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:24.274769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cd650-d7bb-4897-83bf-b90dcd4fddc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:24.275080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cd650-d7bb-4897-83bf-b90dcd4fddc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:24.276495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cd650-d7bb-4897-83bf-b90dcd4fddc3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:24.284972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 533/1078] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:18:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:24.291267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cd650-d7bb-4897-83bf-b90dcd4fddc3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:24.301331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adff05e-942d-4fa8-85b1-c23c6ac6473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:24.302191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff05e-942d-4fa8-85b1-c23c6ac6473d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:24.302721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff05e-942d-4fa8-85b1-c23c6ac6473d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:24.303156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff05e-942d-4fa8-85b1-c23c6ac6473d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:24.310852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adff05e-942d-4fa8-85b1-c23c6ac6473d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:24.311012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:24.312307 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adff05e-942d-4fa8-85b1-c23c6ac6473d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-3adff05e-942d-4fa8-85b1-c23c6ac6473d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:18:24.326165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:24.327047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:24.327934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:18:24.327934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:18:24.327934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:18:24.327934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:18:24.327934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:18:24.327934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:18:24.327934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:24.327934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:24.327934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 546/1079] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:24.333243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adff05e-942d-4fa8-85b1-c23c6ac6473d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:24.392414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cd650-d7bb-4897-83bf-b90dcd4fddc3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:24.425966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e2654-c699-42a8-a88d-c28d458233c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:24.426844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e2654-c699-42a8-a88d-c28d458233c1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:24.427125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e2654-c699-42a8-a88d-c28d458233c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:24.427405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e2654-c699-42a8-a88d-c28d458233c1 None admin] PATH_INFO: `/v3/users/bd9cd5b7f51943d2a5e7a3b257d7be37` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:24.428615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e2654-c699-42a8-a88d-c28d458233c1 None admin] RBAC: Authorizing `identity:get_user(user_id=bd9cd5b7f51943d2a5e7a3b257d7be37)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:24.430831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e2654-c699-42a8-a88d-c28d458233c1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:24.432465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 534/1080] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:24 2022] GET /identity/v3/users/bd9cd5b7f51943d2a5e7a3b257d7be37 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:24.433488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adff05e-942d-4fa8-85b1-c23c6ac6473d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:24.438036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e2654-c699-42a8-a88d-c28d458233c1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:24.467973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b3872-32cc-4196-b054-097035e87fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:24.468664 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3872-32cc-4196-b054-097035e87fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:24.468945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3872-32cc-4196-b054-097035e87fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:24.469217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3872-32cc-4196-b054-097035e87fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:24.469983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b3872-32cc-4196-b054-097035e87fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:24.470287 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b3872-32cc-4196-b054-097035e87fd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:24.471699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b3872-32cc-4196-b054-097035e87fd2 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:24.484354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 547/1081] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:24.490182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b3872-32cc-4196-b054-097035e87fd2 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:24.498964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:24.528831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:24.543068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e2654-c699-42a8-a88d-c28d458233c1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:24.577570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac62936-5a46-4d90-a33f-076c1acdc735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:24.578441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac62936-5a46-4d90-a33f-076c1acdc735 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:24.578722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac62936-5a46-4d90-a33f-076c1acdc735 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:24.578996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac62936-5a46-4d90-a33f-076c1acdc735 None admin] PATH_INFO: `/v3/projects/d14f674c3388406d870f8c75038d5551` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:24.580195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac62936-5a46-4d90-a33f-076c1acdc735 None admin] RBAC: Authorizing `identity:get_project(project_id=d14f674c3388406d870f8c75038d5551)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:24.581664 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac62936-5a46-4d90-a33f-076c1acdc735 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:24.583375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 535/1082] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:18:24 2022] GET /identity/v3/projects/d14f674c3388406d870f8c75038d5551 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:24.589331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac62936-5a46-4d90-a33f-076c1acdc735 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:24.590264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b3872-32cc-4196-b054-097035e87fd2 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:24.625369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caad33-540f-4474-a1e8-f1c38294cacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:24.626251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caad33-540f-4474-a1e8-f1c38294cacc None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:24.626530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caad33-540f-4474-a1e8-f1c38294cacc None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:24.626798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caad33-540f-4474-a1e8-f1c38294cacc None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/ba0bb071b7c04e1da55259f079a9c805/roles/288469399b864e5fa238342d9301217b` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:24.629030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caad33-540f-4474-a1e8-f1c38294cacc None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=ba0bb071b7c04e1da55259f079a9c805, role_id=288469399b864e5fa238342d9301217b)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:24.630447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caad33-540f-4474-a1e8-f1c38294cacc None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:24.687759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac62936-5a46-4d90-a33f-076c1acdc735 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:24.719946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089d512-8b94-4215-80db-4ef8d718aa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:24.720911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089d512-8b94-4215-80db-4ef8d718aa53 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:24.721190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089d512-8b94-4215-80db-4ef8d718aa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:24.721461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089d512-8b94-4215-80db-4ef8d718aa53 None admin] PATH_INFO: `/v3/projects/d14f674c3388406d870f8c75038d5551/users/bd9cd5b7f51943d2a5e7a3b257d7be37/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:24.723404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089d512-8b94-4215-80db-4ef8d718aa53 None admin] RBAC: Authorizing `identity:create_grant(project_id=d14f674c3388406d870f8c75038d5551, user_id=bd9cd5b7f51943d2a5e7a3b257d7be37, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:24.724853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089d512-8b94-4215-80db-4ef8d718aa53 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:24.741297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 548/1083] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:18:24 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/ba0bb071b7c04e1da55259f079a9c805/roles/288469399b864e5fa238342d9301217b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:18:24.840393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 536/1084] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:18:24 2022] PUT /identity/v3/projects/d14f674c3388406d870f8c75038d5551/users/bd9cd5b7f51943d2a5e7a3b257d7be37/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:18:26.871594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b7c0-710c-4595-8807-d776ffbe84a7 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:26.872135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b7c0-710c-4595-8807-d776ffbe84a7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:26.872135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b7c0-710c-4595-8807-d776ffbe84a7 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:26.873550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 549/1085] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:26.878710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68100-2259-4314-a2e0-207c3f5e8663 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:26.879133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68100-2259-4314-a2e0-207c3f5e8663 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:26.879273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68100-2259-4314-a2e0-207c3f5e8663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:26.897295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b5f68100-2259-4314-a2e0-207c3f5e8663 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:26.899719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b5f68100-2259-4314-a2e0-207c3f5e8663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:26.910961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:26.971782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28d2fc-6659-4d2b-a7dd-e5ddc9c44c16 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:26.972061 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28d2fc-6659-4d2b-a7dd-e5ddc9c44c16 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:26.972367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28d2fc-6659-4d2b-a7dd-e5ddc9c44c16 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:26.972876 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 537/1086] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:26.973846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 550/1087] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:18:26.979426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3303d-826c-4605-9041-4e45062442af None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:26.982811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3303d-826c-4605-9041-4e45062442af None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:26.982811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3303d-826c-4605-9041-4e45062442af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:26.996636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-92d3303d-826c-4605-9041-4e45062442af None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:26.997423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28d2fc-6659-4d2b-a7dd-e5ddc9c44c16 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:26.997857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-92d3303d-826c-4605-9041-4e45062442af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:27.066410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:27.067029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 538/1088] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:18:27.090953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3303d-826c-4605-9041-4e45062442af None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:27.102285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28d2fc-6659-4d2b-a7dd-e5ddc9c44c16 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.137141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146942-19e3-4920-a793-b739ac4080c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:27.137874 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146942-19e3-4920-a793-b739ac4080c1 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:27.138147 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146942-19e3-4920-a793-b739ac4080c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:27.138410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146942-19e3-4920-a793-b739ac4080c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:27.150909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39146942-19e3-4920-a793-b739ac4080c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-39146942-19e3-4920-a793-b739ac4080c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:18:27.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:27.161905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:27.162745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 551/1089] 10.222.0.77 () {56 vars in 1120 bytes} [Thu Jun 16 17:18:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:27.164788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:27.168691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146942-19e3-4920-a793-b739ac4080c1 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:27.189629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3303d-826c-4605-9041-4e45062442af None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.224548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c0713-c3c5-4a3a-b6df-afcc91b44307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:27.225354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c0713-c3c5-4a3a-b6df-afcc91b44307 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:27.225640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c0713-c3c5-4a3a-b6df-afcc91b44307 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:27.225924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c0713-c3c5-4a3a-b6df-afcc91b44307 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:27.236181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c0713-c3c5-4a3a-b6df-afcc91b44307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-f57c0713-c3c5-4a3a-b6df-afcc91b44307 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:18:27.244407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:27.245510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:27.246526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 539/1090] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:27.251726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c0713-c3c5-4a3a-b6df-afcc91b44307 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:27.271753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146942-19e3-4920-a793-b739ac4080c1 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.296947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:27.305860 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822648b5-5962-4526-93d3-b586c50a7cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:27.306544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822648b5-5962-4526-93d3-b586c50a7cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:27.306825 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822648b5-5962-4526-93d3-b586c50a7cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:27.307101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822648b5-5962-4526-93d3-b586c50a7cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:27.310944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822648b5-5962-4526-93d3-b586c50a7cf6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:27.310944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822648b5-5962-4526-93d3-b586c50a7cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:27.310944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822648b5-5962-4526-93d3-b586c50a7cf6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:27.318243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 552/1091] 10.222.0.77 () {56 vars in 1115 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:27.325004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822648b5-5962-4526-93d3-b586c50a7cf6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:27.358592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c0713-c3c5-4a3a-b6df-afcc91b44307 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.393228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebfbd1-4f6c-41b7-939b-83428b38c29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:27.393836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebfbd1-4f6c-41b7-939b-83428b38c29a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:27.394124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebfbd1-4f6c-41b7-939b-83428b38c29a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:27.394407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebfbd1-4f6c-41b7-939b-83428b38c29a None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:27.395147 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebfbd1-4f6c-41b7-939b-83428b38c29a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:27.395454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebfbd1-4f6c-41b7-939b-83428b38c29a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:27.396881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebfbd1-4f6c-41b7-939b-83428b38c29a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:27.398963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:27.407242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 540/1092] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:27.419906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebfbd1-4f6c-41b7-939b-83428b38c29a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:27.428097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822648b5-5962-4526-93d3-b586c50a7cf6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.463892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c8598-a19a-4ad4-9eec-ba7cef70af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:27.464721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c8598-a19a-4ad4-9eec-ba7cef70af2f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:27.465008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c8598-a19a-4ad4-9eec-ba7cef70af2f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:27.465286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c8598-a19a-4ad4-9eec-ba7cef70af2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:27.475761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c8598-a19a-4ad4-9eec-ba7cef70af2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:27.477611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c8598-a19a-4ad4-9eec-ba7cef70af2f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-6b0c8598-a19a-4ad4-9eec-ba7cef70af2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:27.495403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:27.496376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:27.497518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:18:27.497518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:27.497518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:27.497518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:27.497518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 553/1093] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:27.502378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c8598-a19a-4ad4-9eec-ba7cef70af2f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:27.514167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebfbd1-4f6c-41b7-939b-83428b38c29a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.544120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:27.547831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fccb61-a76b-4235-9d03-a8c9a38f4352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:27.548743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fccb61-a76b-4235-9d03-a8c9a38f4352 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:27.549032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fccb61-a76b-4235-9d03-a8c9a38f4352 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:27.549361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fccb61-a76b-4235-9d03-a8c9a38f4352 None admin] PATH_INFO: `/v3/users/bd9cd5b7f51943d2a5e7a3b257d7be37` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:27.550574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fccb61-a76b-4235-9d03-a8c9a38f4352 None admin] RBAC: Authorizing `identity:get_user(user_id=bd9cd5b7f51943d2a5e7a3b257d7be37)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:27.552010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fccb61-a76b-4235-9d03-a8c9a38f4352 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:27.556919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 541/1094] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/users/bd9cd5b7f51943d2a5e7a3b257d7be37 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:27.559780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fccb61-a76b-4235-9d03-a8c9a38f4352 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:27.604220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c8598-a19a-4ad4-9eec-ba7cef70af2f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.622178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:27.639274 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1b62f-9a30-46d6-89c2-0920ad6f43bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:27.639991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b62f-9a30-46d6-89c2-0920ad6f43bc None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:27.640319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b62f-9a30-46d6-89c2-0920ad6f43bc None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:27.640596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b62f-9a30-46d6-89c2-0920ad6f43bc None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:27.641311 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1b62f-9a30-46d6-89c2-0920ad6f43bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:27.641618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1b62f-9a30-46d6-89c2-0920ad6f43bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:27.642977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1b62f-9a30-46d6-89c2-0920ad6f43bc None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:27.654740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 554/1095] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:27.658827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fccb61-a76b-4235-9d03-a8c9a38f4352 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.660411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1b62f-9a30-46d6-89c2-0920ad6f43bc None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:27.694232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255581be-0f00-4949-9de6-a05328c210ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:27.695630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255581be-0f00-4949-9de6-a05328c210ad None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:27.696144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255581be-0f00-4949-9de6-a05328c210ad None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:27.696373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255581be-0f00-4949-9de6-a05328c210ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:27.761672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:27.763361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255581be-0f00-4949-9de6-a05328c210ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:27.764596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1b62f-9a30-46d6-89c2-0920ad6f43bc None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.764840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255581be-0f00-4949-9de6-a05328c210ad None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:27.799740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b091794-19c9-44aa-9ef0-b221c210c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:27.800794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b091794-19c9-44aa-9ef0-b221c210c946 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:27.801426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b091794-19c9-44aa-9ef0-b221c210c946 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:27.801701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b091794-19c9-44aa-9ef0-b221c210c946 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:27.811075 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b091794-19c9-44aa-9ef0-b221c210c946 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:27.812563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b091794-19c9-44aa-9ef0-b221c210c946 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-9b091794-19c9-44aa-9ef0-b221c210c946 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:18:27.827194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:27.828333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:27.834607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:27.834607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:27.834607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:18:27.834607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:18:27.834607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:18:27.834607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:18:27.834607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:18:27.834607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:18:27.834607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 17:18:27.834607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:27.835344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:27.835694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 555/1096] 10.222.0.77 () {56 vars in 1093 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:27.835694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b091794-19c9-44aa-9ef0-b221c210c946 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:27.876049 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 542/1097] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 17:18:27.882044 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255581be-0f00-4949-9de6-a05328c210ad None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:27.935739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b091794-19c9-44aa-9ef0-b221c210c946 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.970617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e829ea-2251-45e4-a686-a36c3c4a7043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:27.971308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e829ea-2251-45e4-a686-a36c3c4a7043 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:27.971631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e829ea-2251-45e4-a686-a36c3c4a7043 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:27.971910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e829ea-2251-45e4-a686-a36c3c4a7043 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:27.972833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e829ea-2251-45e4-a686-a36c3c4a7043 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:27.973169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e829ea-2251-45e4-a686-a36c3c4a7043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:27.974622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e829ea-2251-45e4-a686-a36c3c4a7043 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:27.982829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255581be-0f00-4949-9de6-a05328c210ad None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:27.992641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 556/1098] 10.222.0.77 () {56 vars in 1133 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:27.998630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e829ea-2251-45e4-a686-a36c3c4a7043 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:28.017686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:28.018325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eee41-3b18-4b8e-a5fd-a0440b2267cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:28.019010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eee41-3b18-4b8e-a5fd-a0440b2267cc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:28.019285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eee41-3b18-4b8e-a5fd-a0440b2267cc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:28.022970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eee41-3b18-4b8e-a5fd-a0440b2267cc None admin] PATH_INFO: `/v3/projects/d14f674c3388406d870f8c75038d5551` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:28.022970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4eee41-3b18-4b8e-a5fd-a0440b2267cc None admin] RBAC: Authorizing `identity:get_project(project_id=d14f674c3388406d870f8c75038d5551)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:28.022970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4eee41-3b18-4b8e-a5fd-a0440b2267cc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:28.024025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 543/1099] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/projects/d14f674c3388406d870f8c75038d5551 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:28.029860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eee41-3b18-4b8e-a5fd-a0440b2267cc None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:28.063985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:28.108021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e829ea-2251-45e4-a686-a36c3c4a7043 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:28.132889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eee41-3b18-4b8e-a5fd-a0440b2267cc None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:28.142709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741016d-3bb8-4537-855c-99c7152147a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:28.143360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741016d-3bb8-4537-855c-99c7152147a0 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:28.143644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741016d-3bb8-4537-855c-99c7152147a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:28.143917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741016d-3bb8-4537-855c-99c7152147a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:28.168618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0a655-1701-44c5-9f65-caf80e6e8a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:28.169348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0a655-1701-44c5-9f65-caf80e6e8a46 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:28.169708 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0a655-1701-44c5-9f65-caf80e6e8a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:28.170051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0a655-1701-44c5-9f65-caf80e6e8a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:28.170958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0a655-1701-44c5-9f65-caf80e6e8a46 None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=d14f674c3388406d870f8c75038d5551, user.id=bd9cd5b7f51943d2a5e7a3b257d7be37) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:28.171331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0a655-1701-44c5-9f65-caf80e6e8a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:28.172950 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0a655-1701-44c5-9f65-caf80e6e8a46 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:28.179013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 544/1100] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:18:28 2022] GET /identity/v3/role_assignments?user.id=bd9cd5b7f51943d2a5e7a3b257d7be37&scope.project.id=d14f674c3388406d870f8c75038d5551&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:28.214754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741016d-3bb8-4537-855c-99c7152147a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:28.216163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741016d-3bb8-4537-855c-99c7152147a0 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:28.236245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:28.326861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 557/1101] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 17:18:28.333128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0a655-1701-44c5-9f65-caf80e6e8a46 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:28.432102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:28.437802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0a655-1701-44c5-9f65-caf80e6e8a46 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:28.473038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3cc9-7279-40a7-9949-3710f0c6137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:28.474058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3cc9-7279-40a7-9949-3710f0c6137c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:28.474514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3cc9-7279-40a7-9949-3710f0c6137c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:28.475160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3cc9-7279-40a7-9949-3710f0c6137c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:28.486564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b3cc9-7279-40a7-9949-3710f0c6137c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:28.488004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b3cc9-7279-40a7-9949-3710f0c6137c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-801b3cc9-7279-40a7-9949-3710f0c6137c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:28.506187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:28.507224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:28.508444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:18:28.508444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:28.508444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:18:28.508444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:28.508444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 545/1102] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:28.513919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741016d-3bb8-4537-855c-99c7152147a0 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:28.619055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741016d-3bb8-4537-855c-99c7152147a0 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:28.637464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:28.655027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee16c7-5f93-40d8-861b-6671b9121d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:28.659103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee16c7-5f93-40d8-861b-6671b9121d3f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:28.659103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee16c7-5f93-40d8-861b-6671b9121d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:28.659103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee16c7-5f93-40d8-861b-6671b9121d3f None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:28.659103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee16c7-5f93-40d8-861b-6671b9121d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:28.659103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee16c7-5f93-40d8-861b-6671b9121d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:28.659103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee16c7-5f93-40d8-861b-6671b9121d3f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:28.670722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 558/1103] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:28.676511 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3cc9-7279-40a7-9949-3710f0c6137c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:28.782282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3cc9-7279-40a7-9949-3710f0c6137c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:28.816380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0276c-1203-4812-8c16-9520b0222204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:28.817176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0276c-1203-4812-8c16-9520b0222204 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:28.817463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0276c-1203-4812-8c16-9520b0222204 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:28.817742 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0276c-1203-4812-8c16-9520b0222204 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:28.825119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0276c-1203-4812-8c16-9520b0222204 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:28.826554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0276c-1203-4812-8c16-9520b0222204 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-8df0276c-1203-4812-8c16-9520b0222204 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:18:28.841072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:28.842137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:28.843074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:18:28.843074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:18:28.843074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:18:28.843074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:18:28.843074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:18:28.843074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:18:28.843074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:18:28.843074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:28.843074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 546/1104] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:28.847964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee16c7-5f93-40d8-861b-6671b9121d3f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:28.947921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee16c7-5f93-40d8-861b-6671b9121d3f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:28.980248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a624d-8659-4028-be93-408e36ce9b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:28.980906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a624d-8659-4028-be93-408e36ce9b5b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:28.981186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a624d-8659-4028-be93-408e36ce9b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:28.981458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a624d-8659-4028-be93-408e36ce9b5b None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:28.982229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a624d-8659-4028-be93-408e36ce9b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:28.982533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a624d-8659-4028-be93-408e36ce9b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:28.983940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a624d-8659-4028-be93-408e36ce9b5b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:28.996774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 559/1105] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:29.002570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0276c-1203-4812-8c16-9520b0222204 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:29.016454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:29.106898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0276c-1203-4812-8c16-9520b0222204 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:29.140698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c51c26-4097-4037-a037-fb2d45fef8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:29.141352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51c26-4097-4037-a037-fb2d45fef8cb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:29.141634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51c26-4097-4037-a037-fb2d45fef8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:29.141910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51c26-4097-4037-a037-fb2d45fef8cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:29.142716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c51c26-4097-4037-a037-fb2d45fef8cb None admin] RBAC: Adding query filter params (role.id=288469399b864e5fa238342d9301217b, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=ba0bb071b7c04e1da55259f079a9c805) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:29.143027 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c51c26-4097-4037-a037-fb2d45fef8cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:29.144486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c51c26-4097-4037-a037-fb2d45fef8cb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:29.150421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 547/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:18:29 2022] GET /identity/v3/role_assignments?user.id=ba0bb071b7c04e1da55259f079a9c805&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=288469399b864e5fa238342d9301217b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:30.331860 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed690fe-a385-4f66-8ae8-4ceaa7d57bf6 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:30.332417 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed690fe-a385-4f66-8ae8-4ceaa7d57bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:30.332417 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed690fe-a385-4f66-8ae8-4ceaa7d57bf6 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:30.333793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 560/1107] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:30.339487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36fbc-6943-4518-b3b7-5711b055fecd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:30.339908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36fbc-6943-4518-b3b7-5711b055fecd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:30.340048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36fbc-6943-4518-b3b7-5711b055fecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:30.356611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-19b36fbc-6943-4518-b3b7-5711b055fecd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:30.357803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-19b36fbc-6943-4518-b3b7-5711b055fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:30.423523 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 548/1108] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:30.448728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed690fe-a385-4f66-8ae8-4ceaa7d57bf6 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:30.488847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:30.548315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed690fe-a385-4f66-8ae8-4ceaa7d57bf6 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:30.582858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da678f51-8404-4522-b5a0-a4a7772a75d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:30.583589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da678f51-8404-4522-b5a0-a4a7772a75d2 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:30.583868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da678f51-8404-4522-b5a0-a4a7772a75d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:30.584168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da678f51-8404-4522-b5a0-a4a7772a75d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:30.585331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da678f51-8404-4522-b5a0-a4a7772a75d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:30.586747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da678f51-8404-4522-b5a0-a4a7772a75d2 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:30.588390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 561/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:30.594041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b36fbc-6943-4518-b3b7-5711b055fecd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:30.596274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:30.697844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b36fbc-6943-4518-b3b7-5711b055fecd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:30.730075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e02be2-4a56-409f-803d-67032c3e407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:30.730731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02be2-4a56-409f-803d-67032c3e407d None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:30.731011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02be2-4a56-409f-803d-67032c3e407d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:30.731284 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02be2-4a56-409f-803d-67032c3e407d None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:30.731979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02be2-4a56-409f-803d-67032c3e407d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:30.733422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e02be2-4a56-409f-803d-67032c3e407d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:30.837311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 549/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:18:30 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:18:32.993545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5c488-c71e-4ed3-85a5-ef1c9afa0ef3 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:32.994106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5c488-c71e-4ed3-85a5-ef1c9afa0ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:32.994106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5c488-c71e-4ed3-85a5-ef1c9afa0ef3 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:32.995437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 562/1111] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:33.000834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063e6e7-67a6-4b5c-9a1a-a09d33d69949 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:33.001215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063e6e7-67a6-4b5c-9a1a-a09d33d69949 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:33.001399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063e6e7-67a6-4b5c-9a1a-a09d33d69949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:33.019612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6063e6e7-67a6-4b5c-9a1a-a09d33d69949 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:33.020847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6063e6e7-67a6-4b5c-9a1a-a09d33d69949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:33.073229 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:33.086270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 550/1112] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:33.110986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5c488-c71e-4ed3-85a5-ef1c9afa0ef3 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:33.213556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5c488-c71e-4ed3-85a5-ef1c9afa0ef3 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:33.220886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:33.248883 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe2423-c6fb-4c48-9a65-22067c7bb8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:33.249696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe2423-c6fb-4c48-9a65-22067c7bb8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:33.249980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe2423-c6fb-4c48-9a65-22067c7bb8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:33.250256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe2423-c6fb-4c48-9a65-22067c7bb8b6 None admin] PATH_INFO: `/v3/roles/fd4cb9f5c4fb444498c049489198e975` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:33.251723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe2423-c6fb-4c48-9a65-22067c7bb8b6 None admin] RBAC: Authorizing `identity:get_role(role_id=fd4cb9f5c4fb444498c049489198e975)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:33.253177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe2423-c6fb-4c48-9a65-22067c7bb8b6 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:33.254645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 563/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:33 2022] GET /identity/v3/roles/fd4cb9f5c4fb444498c049489198e975 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:33.260465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063e6e7-67a6-4b5c-9a1a-a09d33d69949 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:33.358257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063e6e7-67a6-4b5c-9a1a-a09d33d69949 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:33.391393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75068ceb-f6f1-4e3f-8a7a-530025d3586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:33.392294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75068ceb-f6f1-4e3f-8a7a-530025d3586b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:33.392576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75068ceb-f6f1-4e3f-8a7a-530025d3586b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:33.392851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75068ceb-f6f1-4e3f-8a7a-530025d3586b None admin] PATH_INFO: `/v3/users/95548437327e411eb16ee81e16d9063f` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:33.406387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75068ceb-f6f1-4e3f-8a7a-530025d3586b None admin] RBAC: Authorizing `identity:get_user(user_id=95548437327e411eb16ee81e16d9063f)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:33.407820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75068ceb-f6f1-4e3f-8a7a-530025d3586b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:33.409493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 551/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:33 2022] GET /identity/v3/users/95548437327e411eb16ee81e16d9063f => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:33.416695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe2423-c6fb-4c48-9a65-22067c7bb8b6 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:33.514887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe2423-c6fb-4c48-9a65-22067c7bb8b6 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:33.549362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa118-78f6-4458-9a4a-a6ce39f8874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:33.550014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa118-78f6-4458-9a4a-a6ce39f8874c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:33.550300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa118-78f6-4458-9a4a-a6ce39f8874c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:33.550578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa118-78f6-4458-9a4a-a6ce39f8874c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:33.594043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:33.618816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfa118-78f6-4458-9a4a-a6ce39f8874c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:33.620544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfa118-78f6-4458-9a4a-a6ce39f8874c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:33.715866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 564/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:18:33.722016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75068ceb-f6f1-4e3f-8a7a-530025d3586b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:33.766937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:33.817303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75068ceb-f6f1-4e3f-8a7a-530025d3586b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:33.849885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b503e-1af7-446c-af0c-77c654457fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:33.850724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b503e-1af7-446c-af0c-77c654457fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:33.851624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b503e-1af7-446c-af0c-77c654457fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:33.851799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b503e-1af7-446c-af0c-77c654457fb9 None admin] PATH_INFO: `/v3/projects/d14f674c3388406d870f8c75038d5551` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:33.853001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b503e-1af7-446c-af0c-77c654457fb9 None admin] RBAC: Authorizing `identity:get_project(project_id=d14f674c3388406d870f8c75038d5551)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:33.854407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b503e-1af7-446c-af0c-77c654457fb9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:33.856054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 552/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:18:33 2022] GET /identity/v3/projects/d14f674c3388406d870f8c75038d5551 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:33.862211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa118-78f6-4458-9a4a-a6ce39f8874c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:33.936407 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:33.961062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa118-78f6-4458-9a4a-a6ce39f8874c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:33.995437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf87a59-3e8a-4385-8e64-d6e24f1da793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:33.996103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf87a59-3e8a-4385-8e64-d6e24f1da793 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:33.996391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf87a59-3e8a-4385-8e64-d6e24f1da793 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:33.996663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf87a59-3e8a-4385-8e64-d6e24f1da793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:33.997473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf87a59-3e8a-4385-8e64-d6e24f1da793 None admin] RBAC: Adding query filter params (role.id=fd4cb9f5c4fb444498c049489198e975, scope.project.id=d14f674c3388406d870f8c75038d5551, user.id=95548437327e411eb16ee81e16d9063f) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:33.997782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf87a59-3e8a-4385-8e64-d6e24f1da793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:33.999200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf87a59-3e8a-4385-8e64-d6e24f1da793 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:34.004509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 565/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:18:33 2022] GET /identity/v3/role_assignments?user.id=95548437327e411eb16ee81e16d9063f&scope.project.id=d14f674c3388406d870f8c75038d5551&role.id=fd4cb9f5c4fb444498c049489198e975 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:36.100056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da013b-ad95-4bf4-815a-5ebaf394218a None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:36.101118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da013b-ad95-4bf4-815a-5ebaf394218a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:36.101254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da013b-ad95-4bf4-815a-5ebaf394218a None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:36.103117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 553/1118] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:36.108223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958067-7a23-4cbd-8cf1-cc9a72723e48 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:36.108612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958067-7a23-4cbd-8cf1-cc9a72723e48 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:36.108781 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958067-7a23-4cbd-8cf1-cc9a72723e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:36.125177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-b9958067-7a23-4cbd-8cf1-cc9a72723e48 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:36.126355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b9958067-7a23-4cbd-8cf1-cc9a72723e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:36.191151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 566/1119] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:36.214552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da013b-ad95-4bf4-815a-5ebaf394218a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:36.316682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da013b-ad95-4bf4-815a-5ebaf394218a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:36.331374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:36.352368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cfe79-beb3-41c6-8927-75de994a75c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:36.353185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cfe79-beb3-41c6-8927-75de994a75c5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:36.353466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cfe79-beb3-41c6-8927-75de994a75c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:36.353740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cfe79-beb3-41c6-8927-75de994a75c5 None admin] PATH_INFO: `/v3/roles/fd4cb9f5c4fb444498c049489198e975` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:36.355216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cfe79-beb3-41c6-8927-75de994a75c5 None admin] RBAC: Authorizing `identity:get_role(role_id=fd4cb9f5c4fb444498c049489198e975)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:36.356629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cfe79-beb3-41c6-8927-75de994a75c5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:36.358455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 554/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:36 2022] GET /identity/v3/roles/fd4cb9f5c4fb444498c049489198e975 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:36.363960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9958067-7a23-4cbd-8cf1-cc9a72723e48 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:36.428878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:36.460502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9958067-7a23-4cbd-8cf1-cc9a72723e48 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:36.494537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0c191-9958-482f-906e-ead919c69c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:36.495410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0c191-9958-482f-906e-ead919c69c44 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:36.495692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0c191-9958-482f-906e-ead919c69c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:36.495966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0c191-9958-482f-906e-ead919c69c44 None admin] PATH_INFO: `/v3/users/95548437327e411eb16ee81e16d9063f` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:36.497179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0c191-9958-482f-906e-ead919c69c44 None admin] RBAC: Authorizing `identity:get_user(user_id=95548437327e411eb16ee81e16d9063f)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:36.498601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0c191-9958-482f-906e-ead919c69c44 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:36.500259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 567/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:36 2022] GET /identity/v3/users/95548437327e411eb16ee81e16d9063f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:36.505954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cfe79-beb3-41c6-8927-75de994a75c5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:36.604403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cfe79-beb3-41c6-8927-75de994a75c5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:36.637386 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406af9f-43e9-4cfd-8635-073fc2dee701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:36.638236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406af9f-43e9-4cfd-8635-073fc2dee701 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:36.638512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406af9f-43e9-4cfd-8635-073fc2dee701 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:36.638784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406af9f-43e9-4cfd-8635-073fc2dee701 None admin] PATH_INFO: `/v3/projects/d14f674c3388406d870f8c75038d5551` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:36.639929 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406af9f-43e9-4cfd-8635-073fc2dee701 None admin] RBAC: Authorizing `identity:get_project(project_id=d14f674c3388406d870f8c75038d5551)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:36.641384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406af9f-43e9-4cfd-8635-073fc2dee701 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:36.643054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 555/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:18:36 2022] GET /identity/v3/projects/d14f674c3388406d870f8c75038d5551 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:36.650263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0c191-9958-482f-906e-ead919c69c44 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:36.751594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0c191-9958-482f-906e-ead919c69c44 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:36.786155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cae2c-ed1f-4976-9623-2c8323d1c317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:36.787037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cae2c-ed1f-4976-9623-2c8323d1c317 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:36.787321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cae2c-ed1f-4976-9623-2c8323d1c317 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:36.787596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cae2c-ed1f-4976-9623-2c8323d1c317 None admin] PATH_INFO: `/v3/projects/d14f674c3388406d870f8c75038d5551/users/95548437327e411eb16ee81e16d9063f/roles/fd4cb9f5c4fb444498c049489198e975` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:36.790389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cae2c-ed1f-4976-9623-2c8323d1c317 None admin] RBAC: Authorizing `identity:create_grant(project_id=d14f674c3388406d870f8c75038d5551, user_id=95548437327e411eb16ee81e16d9063f, role_id=fd4cb9f5c4fb444498c049489198e975)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:36.791811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cae2c-ed1f-4976-9623-2c8323d1c317 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:36.794826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:37.017391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 568/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:18:36 2022] PUT /identity/v3/projects/d14f674c3388406d870f8c75038d5551/users/95548437327e411eb16ee81e16d9063f/roles/fd4cb9f5c4fb444498c049489198e975 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:18:39.187242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0810d9-d0d6-4ba1-9fbe-2cee73dcab5d None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:39.187809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0810d9-d0d6-4ba1-9fbe-2cee73dcab5d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:39.187809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0810d9-d0d6-4ba1-9fbe-2cee73dcab5d None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:39.189150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 556/1124] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:39.194769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3287379-349c-49a5-a13b-5bf0b3b9aab9 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:39.195209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3287379-349c-49a5-a13b-5bf0b3b9aab9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:39.195312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3287379-349c-49a5-a13b-5bf0b3b9aab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:39.212395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-b3287379-349c-49a5-a13b-5bf0b3b9aab9 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:39.213571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b3287379-349c-49a5-a13b-5bf0b3b9aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:39.278516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 569/1125] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:39.301781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0810d9-d0d6-4ba1-9fbe-2cee73dcab5d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:39.351591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:39.401532 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0810d9-d0d6-4ba1-9fbe-2cee73dcab5d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:39.434054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a7f5c-f616-4b2e-b312-6d017075638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:39.434900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a7f5c-f616-4b2e-b312-6d017075638c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:39.435179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a7f5c-f616-4b2e-b312-6d017075638c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:39.435450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a7f5c-f616-4b2e-b312-6d017075638c None admin] PATH_INFO: `/v3/roles/fd4cb9f5c4fb444498c049489198e975` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:39.436906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a7f5c-f616-4b2e-b312-6d017075638c None admin] RBAC: Authorizing `identity:get_role(role_id=fd4cb9f5c4fb444498c049489198e975)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:39.438299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a7f5c-f616-4b2e-b312-6d017075638c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:39.439642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 557/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:39 2022] GET /identity/v3/roles/fd4cb9f5c4fb444498c049489198e975 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:39.445610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3287379-349c-49a5-a13b-5bf0b3b9aab9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:39.543730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3287379-349c-49a5-a13b-5bf0b3b9aab9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:39.568754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:39.577291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5ae91-d91c-4a6a-8abc-186acda29cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:39.585673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5ae91-d91c-4a6a-8abc-186acda29cce None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:39.585673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5ae91-d91c-4a6a-8abc-186acda29cce None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:39.585673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5ae91-d91c-4a6a-8abc-186acda29cce None admin] PATH_INFO: `/v3/users/95548437327e411eb16ee81e16d9063f` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:39.585673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5ae91-d91c-4a6a-8abc-186acda29cce None admin] RBAC: Authorizing `identity:get_user(user_id=95548437327e411eb16ee81e16d9063f)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:39.585673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5ae91-d91c-4a6a-8abc-186acda29cce None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:39.585673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 570/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:39 2022] GET /identity/v3/users/95548437327e411eb16ee81e16d9063f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:39.589308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a7f5c-f616-4b2e-b312-6d017075638c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:39.688057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a7f5c-f616-4b2e-b312-6d017075638c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:39.705630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:39.722805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a336da3-06c6-4e90-b0e3-e50c014ce105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:39.723452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a336da3-06c6-4e90-b0e3-e50c014ce105 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:39.724478 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a336da3-06c6-4e90-b0e3-e50c014ce105 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:39.724478 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a336da3-06c6-4e90-b0e3-e50c014ce105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:39.790219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a336da3-06c6-4e90-b0e3-e50c014ce105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:39.791697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a336da3-06c6-4e90-b0e3-e50c014ce105 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:39.887352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 558/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:18:39.893370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5ae91-d91c-4a6a-8abc-186acda29cce None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:39.988149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5ae91-d91c-4a6a-8abc-186acda29cce None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:40.021306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae7d79-5b49-474e-8c82-fb2bb252c59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:40.022155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae7d79-5b49-474e-8c82-fb2bb252c59d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:40.023026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae7d79-5b49-474e-8c82-fb2bb252c59d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:40.023296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae7d79-5b49-474e-8c82-fb2bb252c59d None admin] PATH_INFO: `/v3/projects/d14f674c3388406d870f8c75038d5551` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:40.024492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae7d79-5b49-474e-8c82-fb2bb252c59d None admin] RBAC: Authorizing `identity:get_project(project_id=d14f674c3388406d870f8c75038d5551)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:40.025905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae7d79-5b49-474e-8c82-fb2bb252c59d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:40.027558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 571/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:18:39 2022] GET /identity/v3/projects/d14f674c3388406d870f8c75038d5551 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:40.033875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a336da3-06c6-4e90-b0e3-e50c014ce105 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:40.052196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:40.133472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a336da3-06c6-4e90-b0e3-e50c014ce105 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:40.167387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcdf04-466e-40ed-8ff1-7be84c99b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:40.168027 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcdf04-466e-40ed-8ff1-7be84c99b743 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:40.168341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcdf04-466e-40ed-8ff1-7be84c99b743 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:40.168616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcdf04-466e-40ed-8ff1-7be84c99b743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:40.169421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcdf04-466e-40ed-8ff1-7be84c99b743 None admin] RBAC: Adding query filter params (role.id=fd4cb9f5c4fb444498c049489198e975, scope.project.id=d14f674c3388406d870f8c75038d5551, user.id=95548437327e411eb16ee81e16d9063f) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:40.169729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcdf04-466e-40ed-8ff1-7be84c99b743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:40.171133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcdf04-466e-40ed-8ff1-7be84c99b743 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:40.176823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 559/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:18:40 2022] GET /identity/v3/role_assignments?user.id=95548437327e411eb16ee81e16d9063f&scope.project.id=d14f674c3388406d870f8c75038d5551&role.id=fd4cb9f5c4fb444498c049489198e975 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:42.305492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaacff-5b0c-4022-b73e-0a8b39a6f4c1 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:42.306030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaacff-5b0c-4022-b73e-0a8b39a6f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:42.306030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaacff-5b0c-4022-b73e-0a8b39a6f4c1 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:42.307390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 572/1131] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:42.312498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc290-0cf1-4a5c-b3ce-05d758d2e6aa None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:42.312913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc290-0cf1-4a5c-b3ce-05d758d2e6aa None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:42.313046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc290-0cf1-4a5c-b3ce-05d758d2e6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:42.329981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-758fc290-0cf1-4a5c-b3ce-05d758d2e6aa None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:42.331152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-758fc290-0cf1-4a5c-b3ce-05d758d2e6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:42.397040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 560/1132] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:42.420506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaacff-5b0c-4022-b73e-0a8b39a6f4c1 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:42.482620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:42.520255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaacff-5b0c-4022-b73e-0a8b39a6f4c1 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:42.555679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3461d-5aa9-474e-8527-62f2deeca58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:42.556453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3461d-5aa9-474e-8527-62f2deeca58d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:42.556740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3461d-5aa9-474e-8527-62f2deeca58d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:42.557015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3461d-5aa9-474e-8527-62f2deeca58d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:42.558234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3461d-5aa9-474e-8527-62f2deeca58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:42.559663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3461d-5aa9-474e-8527-62f2deeca58d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:42.561351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 573/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:42.567017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fc290-0cf1-4a5c-b3ce-05d758d2e6aa None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:42.581700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:42.669951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fc290-0cf1-4a5c-b3ce-05d758d2e6aa None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:42.703727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e5c92-4593-427d-bc21-fbedd993f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:42.704423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5c92-4593-427d-bc21-fbedd993f170 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:42.704708 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5c92-4593-427d-bc21-fbedd993f170 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:42.704989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5c92-4593-427d-bc21-fbedd993f170 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:42.705695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e5c92-4593-427d-bc21-fbedd993f170 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:42.707162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e5c92-4593-427d-bc21-fbedd993f170 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:42.867676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 561/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:18:42 2022] POST /identity/v3/projects => generated 311 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:18:45.006017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d4d4c-a34f-4694-acb2-152f6a4bf2f2 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:45.006588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d4d4c-a34f-4694-acb2-152f6a4bf2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:45.006766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d4d4c-a34f-4694-acb2-152f6a4bf2f2 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:45.008329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 574/1135] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:45.013778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f299c-07a8-4560-9f4e-4bf874c144b1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:45.014204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f299c-07a8-4560-9f4e-4bf874c144b1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:45.014305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f299c-07a8-4560-9f4e-4bf874c144b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:45.031403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-210f299c-07a8-4560-9f4e-4bf874c144b1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:45.032719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-210f299c-07a8-4560-9f4e-4bf874c144b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:45.091346 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:45.099440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 562/1136] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:45.125114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d4d4c-a34f-4694-acb2-152f6a4bf2f2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:45.226653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d4d4c-a34f-4694-acb2-152f6a4bf2f2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:45.254494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:45.261081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a3f5e-9eb6-4e4b-abd2-be9bef212936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:45.261818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a3f5e-9eb6-4e4b-abd2-be9bef212936 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:45.262103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a3f5e-9eb6-4e4b-abd2-be9bef212936 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:45.262380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a3f5e-9eb6-4e4b-abd2-be9bef212936 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:45.263626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a3f5e-9eb6-4e4b-abd2-be9bef212936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:45.265072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a3f5e-9eb6-4e4b-abd2-be9bef212936 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:45.266678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 575/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:18:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:45.273180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f299c-07a8-4560-9f4e-4bf874c144b1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:45.368938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f299c-07a8-4560-9f4e-4bf874c144b1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:45.401788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1ea12-353a-4599-96c5-31eabd4beee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:45.402442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1ea12-353a-4599-96c5-31eabd4beee7 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:45.402723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1ea12-353a-4599-96c5-31eabd4beee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:45.402994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1ea12-353a-4599-96c5-31eabd4beee7 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:45.403693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1ea12-353a-4599-96c5-31eabd4beee7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:45.405132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1ea12-353a-4599-96c5-31eabd4beee7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:45.518209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 563/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:18:45 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:18:47.677317 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f288-6634-492a-b8e9-fddccae994c6 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:47.677865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f288-6634-492a-b8e9-fddccae994c6 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:47.677865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f288-6634-492a-b8e9-fddccae994c6 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:47.679325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 576/1139] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:47.684431 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec405f-7829-4fe6-b3b6-18bef97281a9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:47.684868 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec405f-7829-4fe6-b3b6-18bef97281a9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:47.684983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec405f-7829-4fe6-b3b6-18bef97281a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:47.701487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-76ec405f-7829-4fe6-b3b6-18bef97281a9 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:47.702650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-76ec405f-7829-4fe6-b3b6-18bef97281a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:47.749452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:47.769172 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 564/1140] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:47.793201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490f288-6634-492a-b8e9-fddccae994c6 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:47.904721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490f288-6634-492a-b8e9-fddccae994c6 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:47.939043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807135a-3f4e-4b03-b982-097150dd2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:47.939833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807135a-3f4e-4b03-b982-097150dd2fcc None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:47.940146 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807135a-3f4e-4b03-b982-097150dd2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:47.940429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807135a-3f4e-4b03-b982-097150dd2fcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:47.950992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807135a-3f4e-4b03-b982-097150dd2fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-3807135a-3f4e-4b03-b982-097150dd2fcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:18:47.958613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:47.959835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:47.960939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 577/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:47.966004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec405f-7829-4fe6-b3b6-18bef97281a9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:48.070083 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec405f-7829-4fe6-b3b6-18bef97281a9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:48.106992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae77f-6639-46cc-a57c-d03e63207dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:48.107651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae77f-6639-46cc-a57c-d03e63207dac None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:48.107933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae77f-6639-46cc-a57c-d03e63207dac None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:48.108242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae77f-6639-46cc-a57c-d03e63207dac None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:48.108975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcae77f-6639-46cc-a57c-d03e63207dac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:48.109280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcae77f-6639-46cc-a57c-d03e63207dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:48.110640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcae77f-6639-46cc-a57c-d03e63207dac None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:48.119359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 565/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:48.125193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807135a-3f4e-4b03-b982-097150dd2fcc None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:48.183383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:48.224681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807135a-3f4e-4b03-b982-097150dd2fcc None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:48.258608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1c5de-e21d-4264-aa0b-f92d1fee437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:48.259483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1c5de-e21d-4264-aa0b-f92d1fee437c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:48.259767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1c5de-e21d-4264-aa0b-f92d1fee437c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:48.260043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1c5de-e21d-4264-aa0b-f92d1fee437c None admin] PATH_INFO: `/v3/users/ae616b1d2f104522b3c609a932078e67` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:48.273295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1c5de-e21d-4264-aa0b-f92d1fee437c None admin] RBAC: Authorizing `identity:get_user(user_id=ae616b1d2f104522b3c609a932078e67)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:48.274858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1c5de-e21d-4264-aa0b-f92d1fee437c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:48.276623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 578/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:48 2022] GET /identity/v3/users/ae616b1d2f104522b3c609a932078e67 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:48.282402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae77f-6639-46cc-a57c-d03e63207dac None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:48.325114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:48.378746 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae77f-6639-46cc-a57c-d03e63207dac None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:48.411464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f711-cf35-49d5-8651-266e828209e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:48.412117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f711-cf35-49d5-8651-266e828209e7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:48.412401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f711-cf35-49d5-8651-266e828209e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:48.412698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f711-cf35-49d5-8651-266e828209e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:48.477778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f711-cf35-49d5-8651-266e828209e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:48.479133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f711-cf35-49d5-8651-266e828209e7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:48.519335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:48.574648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 566/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:18:48.580690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1c5de-e21d-4264-aa0b-f92d1fee437c None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:48.677325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1c5de-e21d-4264-aa0b-f92d1fee437c None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:48.693690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:48.711482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315b61d-962e-4fd2-8902-9366fc45bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:48.712396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315b61d-962e-4fd2-8902-9366fc45bbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:48.712676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315b61d-962e-4fd2-8902-9366fc45bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:48.712944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315b61d-962e-4fd2-8902-9366fc45bbf8 None admin] PATH_INFO: `/v3/projects/7a7979065e8442aebe1fa3058c3cdbd6` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:48.714101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315b61d-962e-4fd2-8902-9366fc45bbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=7a7979065e8442aebe1fa3058c3cdbd6)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:48.715514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315b61d-962e-4fd2-8902-9366fc45bbf8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:48.717281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 579/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:18:48 2022] GET /identity/v3/projects/7a7979065e8442aebe1fa3058c3cdbd6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:18:48.723480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f711-cf35-49d5-8651-266e828209e7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:48.822887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f711-cf35-49d5-8651-266e828209e7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:48.855986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c6172-6f50-4267-b21a-ae169085bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:48.856663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c6172-6f50-4267-b21a-ae169085bab8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:48.856944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c6172-6f50-4267-b21a-ae169085bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:48.857216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c6172-6f50-4267-b21a-ae169085bab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:48.858020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c6172-6f50-4267-b21a-ae169085bab8 None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=7a7979065e8442aebe1fa3058c3cdbd6, user.id=ae616b1d2f104522b3c609a932078e67) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:48.858328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c6172-6f50-4267-b21a-ae169085bab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:48.859741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c6172-6f50-4267-b21a-ae169085bab8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:48.865069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 567/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:18:48 2022] GET /identity/v3/role_assignments?user.id=ae616b1d2f104522b3c609a932078e67&scope.project.id=7a7979065e8442aebe1fa3058c3cdbd6&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:50.944137 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813052bc-2c0e-47d7-80ff-1fefb85c4712 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:50.944731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813052bc-2c0e-47d7-80ff-1fefb85c4712 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:50.944731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813052bc-2c0e-47d7-80ff-1fefb85c4712 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:50.946052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 580/1147] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:50.951116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd88272-862b-42bb-b3e8-4e8a8803f15e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:50.951531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd88272-862b-42bb-b3e8-4e8a8803f15e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:50.951668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd88272-862b-42bb-b3e8-4e8a8803f15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:50.963182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:50.968889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8bd88272-862b-42bb-b3e8-4e8a8803f15e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:50.970070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8bd88272-862b-42bb-b3e8-4e8a8803f15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:51.035573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 568/1148] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:51.058190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813052bc-2c0e-47d7-80ff-1fefb85c4712 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:51.169809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813052bc-2c0e-47d7-80ff-1fefb85c4712 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:51.207595 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134635-fd06-4cff-95a6-939ca2b4ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:51.208365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134635-fd06-4cff-95a6-939ca2b4ca06 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:51.208649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134635-fd06-4cff-95a6-939ca2b4ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:51.208923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134635-fd06-4cff-95a6-939ca2b4ca06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:51.220239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134635-fd06-4cff-95a6-939ca2b4ca06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-cf134635-fd06-4cff-95a6-939ca2b4ca06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:18:51.228544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:51.229816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:51.230734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 581/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:18:51.236142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd88272-862b-42bb-b3e8-4e8a8803f15e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:51.335416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd88272-862b-42bb-b3e8-4e8a8803f15e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:51.367774 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dfc5e-98c3-4ec8-b293-77b8aa393aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:51.368469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dfc5e-98c3-4ec8-b293-77b8aa393aae None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:51.368753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dfc5e-98c3-4ec8-b293-77b8aa393aae None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:51.369027 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dfc5e-98c3-4ec8-b293-77b8aa393aae None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:51.369756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5dfc5e-98c3-4ec8-b293-77b8aa393aae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:51.370060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5dfc5e-98c3-4ec8-b293-77b8aa393aae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:51.371422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5dfc5e-98c3-4ec8-b293-77b8aa393aae None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:51.373584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:51.379687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 569/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:51.386354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134635-fd06-4cff-95a6-939ca2b4ca06 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:51.431419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:51.483163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134635-fd06-4cff-95a6-939ca2b4ca06 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:51.516798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6d178-5e2e-488f-b42e-8a7b0cb1c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:51.517658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d178-5e2e-488f-b42e-8a7b0cb1c390 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:51.517935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d178-5e2e-488f-b42e-8a7b0cb1c390 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:51.518203 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d178-5e2e-488f-b42e-8a7b0cb1c390 None admin] PATH_INFO: `/v3/users/ae616b1d2f104522b3c609a932078e67` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:51.519367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6d178-5e2e-488f-b42e-8a7b0cb1c390 None admin] RBAC: Authorizing `identity:get_user(user_id=ae616b1d2f104522b3c609a932078e67)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:51.520805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6d178-5e2e-488f-b42e-8a7b0cb1c390 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:51.522452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 582/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:51 2022] GET /identity/v3/users/ae616b1d2f104522b3c609a932078e67 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:51.528248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dfc5e-98c3-4ec8-b293-77b8aa393aae None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:51.625602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dfc5e-98c3-4ec8-b293-77b8aa393aae None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:51.658539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa75756-5cf0-41cb-a418-36686bbf8143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:51.659388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75756-5cf0-41cb-a418-36686bbf8143 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:51.659667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75756-5cf0-41cb-a418-36686bbf8143 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:51.659937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75756-5cf0-41cb-a418-36686bbf8143 None admin] PATH_INFO: `/v3/projects/7a7979065e8442aebe1fa3058c3cdbd6` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:51.661119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa75756-5cf0-41cb-a418-36686bbf8143 None admin] RBAC: Authorizing `identity:get_project(project_id=7a7979065e8442aebe1fa3058c3cdbd6)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:51.663225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa75756-5cf0-41cb-a418-36686bbf8143 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:51.665002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 570/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:18:51 2022] GET /identity/v3/projects/7a7979065e8442aebe1fa3058c3cdbd6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:51.670893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6d178-5e2e-488f-b42e-8a7b0cb1c390 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:51.768203 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6d178-5e2e-488f-b42e-8a7b0cb1c390 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:51.781180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:51.802444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157e6d8-0c6a-4f51-9dbf-40f0ed2e73f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:51.804863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157e6d8-0c6a-4f51-9dbf-40f0ed2e73f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:51.804863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157e6d8-0c6a-4f51-9dbf-40f0ed2e73f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:51.804863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157e6d8-0c6a-4f51-9dbf-40f0ed2e73f7 None admin] PATH_INFO: `/v3/projects/7a7979065e8442aebe1fa3058c3cdbd6/users/ae616b1d2f104522b3c609a932078e67/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:51.806003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157e6d8-0c6a-4f51-9dbf-40f0ed2e73f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a7979065e8442aebe1fa3058c3cdbd6, user_id=ae616b1d2f104522b3c609a932078e67, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:51.807424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157e6d8-0c6a-4f51-9dbf-40f0ed2e73f7 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:51.962679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 583/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:18:51 2022] PUT /identity/v3/projects/7a7979065e8442aebe1fa3058c3cdbd6/users/ae616b1d2f104522b3c609a932078e67/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:18:54.067410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d446b93-20ca-4e45-93bf-bd4d0386467e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:54.067972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d446b93-20ca-4e45-93bf-bd4d0386467e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:54.067972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d446b93-20ca-4e45-93bf-bd4d0386467e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:54.069882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 571/1154] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:54.074966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76ae2-746d-41cd-911e-f8438665b55c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:54.075343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76ae2-746d-41cd-911e-f8438665b55c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:54.075526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76ae2-746d-41cd-911e-f8438665b55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:54.092569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-51c76ae2-746d-41cd-911e-f8438665b55c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:54.093743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-51c76ae2-746d-41cd-911e-f8438665b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:54.158618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 584/1155] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:54.181695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d446b93-20ca-4e45-93bf-bd4d0386467e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:54.250162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:54.293073 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d446b93-20ca-4e45-93bf-bd4d0386467e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:54.326000 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826d17e-0dad-4eb6-87d6-057fe489582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:54.326730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d17e-0dad-4eb6-87d6-057fe489582c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:54.327007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d17e-0dad-4eb6-87d6-057fe489582c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:54.327275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d17e-0dad-4eb6-87d6-057fe489582c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:54.337790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826d17e-0dad-4eb6-87d6-057fe489582c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-c826d17e-0dad-4eb6-87d6-057fe489582c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:18:54.345321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:54.346408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:18:54.347432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 572/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:18:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:54.352904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c76ae2-746d-41cd-911e-f8438665b55c None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:54.449689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c76ae2-746d-41cd-911e-f8438665b55c None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:54.451169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:54.482438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a6cc1-f737-4ca3-9657-dbb42f7f4e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:54.483090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a6cc1-f737-4ca3-9657-dbb42f7f4e26 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:54.483372 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a6cc1-f737-4ca3-9657-dbb42f7f4e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:54.483643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a6cc1-f737-4ca3-9657-dbb42f7f4e26 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:54.484404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a6cc1-f737-4ca3-9657-dbb42f7f4e26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:54.484714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a6cc1-f737-4ca3-9657-dbb42f7f4e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:54.486065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a6cc1-f737-4ca3-9657-dbb42f7f4e26 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:54.494895 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 585/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:54.500897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826d17e-0dad-4eb6-87d6-057fe489582c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:54.603491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826d17e-0dad-4eb6-87d6-057fe489582c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:54.628731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:54.638801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982f95-442d-4b86-a725-4aac2913be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:54.639679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982f95-442d-4b86-a725-4aac2913be29 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:54.639961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982f95-442d-4b86-a725-4aac2913be29 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:54.640288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00982f95-442d-4b86-a725-4aac2913be29 None admin] PATH_INFO: `/v3/users/ae616b1d2f104522b3c609a932078e67` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:54.641510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00982f95-442d-4b86-a725-4aac2913be29 None admin] RBAC: Authorizing `identity:get_user(user_id=ae616b1d2f104522b3c609a932078e67)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:54.642940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00982f95-442d-4b86-a725-4aac2913be29 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:54.644597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 573/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:18:54 2022] GET /identity/v3/users/ae616b1d2f104522b3c609a932078e67 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:54.650719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a6cc1-f737-4ca3-9657-dbb42f7f4e26 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:54.747301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a6cc1-f737-4ca3-9657-dbb42f7f4e26 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:54.780035 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876a954-8ead-41f7-9ddd-739b730fe6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:54.780692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876a954-8ead-41f7-9ddd-739b730fe6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:54.780974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876a954-8ead-41f7-9ddd-739b730fe6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:54.781246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876a954-8ead-41f7-9ddd-739b730fe6f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:54.811776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:54.847195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876a954-8ead-41f7-9ddd-739b730fe6f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:54.848668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876a954-8ead-41f7-9ddd-739b730fe6f8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:54.947767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 586/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:18:54.953765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982f95-442d-4b86-a725-4aac2913be29 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:55.053903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00982f95-442d-4b86-a725-4aac2913be29 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:55.086396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c1d17-2df3-4127-a455-d156ce39c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:55.087252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c1d17-2df3-4127-a455-d156ce39c3ef None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:55.087536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c1d17-2df3-4127-a455-d156ce39c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:55.087809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c1d17-2df3-4127-a455-d156ce39c3ef None admin] PATH_INFO: `/v3/projects/7a7979065e8442aebe1fa3058c3cdbd6` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:55.088999 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c1d17-2df3-4127-a455-d156ce39c3ef None admin] RBAC: Authorizing `identity:get_project(project_id=7a7979065e8442aebe1fa3058c3cdbd6)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:55.090419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c1d17-2df3-4127-a455-d156ce39c3ef None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:55.092096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 574/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:18:54 2022] GET /identity/v3/projects/7a7979065e8442aebe1fa3058c3cdbd6 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:55.098214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876a954-8ead-41f7-9ddd-739b730fe6f8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:55.161179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:55.199541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876a954-8ead-41f7-9ddd-739b730fe6f8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:55.233150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeceb0-5553-4d6d-b414-9e56fe0d343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:55.233794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeceb0-5553-4d6d-b414-9e56fe0d343c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:55.234073 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeceb0-5553-4d6d-b414-9e56fe0d343c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:55.234347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeceb0-5553-4d6d-b414-9e56fe0d343c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:55.235153 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeceb0-5553-4d6d-b414-9e56fe0d343c None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=7a7979065e8442aebe1fa3058c3cdbd6, user.id=ae616b1d2f104522b3c609a932078e67) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:55.235458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeceb0-5553-4d6d-b414-9e56fe0d343c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:55.236899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeceb0-5553-4d6d-b414-9e56fe0d343c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:55.243127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 587/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:18:55 2022] GET /identity/v3/role_assignments?user.id=ae616b1d2f104522b3c609a932078e67&scope.project.id=7a7979065e8442aebe1fa3058c3cdbd6&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:18:57.366321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1ac87-30c6-4ff0-bafc-aad8293f211e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:57.366845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1ac87-30c6-4ff0-bafc-aad8293f211e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:57.366845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1ac87-30c6-4ff0-bafc-aad8293f211e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:57.368255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 575/1162] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:18:57.373513 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a092-87a0-4723-8074-ec2b6b72f393 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:57.373907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a092-87a0-4723-8074-ec2b6b72f393 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:57.374079 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a092-87a0-4723-8074-ec2b6b72f393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:57.391312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-c825a092-87a0-4723-8074-ec2b6b72f393 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:18:57.392533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c825a092-87a0-4723-8074-ec2b6b72f393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:18:57.459875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 588/1163] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:18:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:18:57.482576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1ac87-30c6-4ff0-bafc-aad8293f211e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:57.544529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:57.585531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1ac87-30c6-4ff0-bafc-aad8293f211e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:57.619826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac84ab7-11d1-4795-aba5-ab6c516cc7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:57.621000 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84ab7-11d1-4795-aba5-ab6c516cc7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:57.621000 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84ab7-11d1-4795-aba5-ab6c516cc7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:57.621187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84ab7-11d1-4795-aba5-ab6c516cc7d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:57.689610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac84ab7-11d1-4795-aba5-ab6c516cc7d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:57.691068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac84ab7-11d1-4795-aba5-ab6c516cc7d0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:57.750500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:57.795797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825a092-87a0-4723-8074-ec2b6b72f393 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:57.796143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 576/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:18:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:18:57.861467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:18:57.902693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825a092-87a0-4723-8074-ec2b6b72f393 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:57.935470 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4fb1b-a2ed-4d8a-bc31-34705e247e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:57.936285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4fb1b-a2ed-4d8a-bc31-34705e247e2a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:57.936567 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4fb1b-a2ed-4d8a-bc31-34705e247e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:57.936838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4fb1b-a2ed-4d8a-bc31-34705e247e2a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:57.943989 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4fb1b-a2ed-4d8a-bc31-34705e247e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:57.945532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4fb1b-a2ed-4d8a-bc31-34705e247e2a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-34f4fb1b-a2ed-4d8a-bc31-34705e247e2a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:18:57.960197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:18:57.961478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:18:57.962693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 589/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Jun 16 17:18:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:18:57.967316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac84ab7-11d1-4795-aba5-ab6c516cc7d0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:18:58.062048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac84ab7-11d1-4795-aba5-ab6c516cc7d0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:18:58.095201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09a15f-b572-4d8c-a0bf-a56a02d707c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:18:58.095845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09a15f-b572-4d8c-a0bf-a56a02d707c4 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:18:58.096151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09a15f-b572-4d8c-a0bf-a56a02d707c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:18:58.096425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09a15f-b572-4d8c-a0bf-a56a02d707c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:18:58.097117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09a15f-b572-4d8c-a0bf-a56a02d707c4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:18:58.097418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09a15f-b572-4d8c-a0bf-a56a02d707c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:18:58.098760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09a15f-b572-4d8c-a0bf-a56a02d707c4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:18:58.105754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 577/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Thu Jun 16 17:18:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:00.204418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5272-157f-4fdb-80e1-feb743e95df4 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:00.204934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5272-157f-4fdb-80e1-feb743e95df4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:00.205045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5272-157f-4fdb-80e1-feb743e95df4 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:00.206336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 590/1167] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:00.212150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9e85-beca-44c1-8a11-128d5b64ba05 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:00.212542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9e85-beca-44c1-8a11-128d5b64ba05 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:00.212714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9e85-beca-44c1-8a11-128d5b64ba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:00.228885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-945d9e85-beca-44c1-8a11-128d5b64ba05 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:00.230052 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-945d9e85-beca-44c1-8a11-128d5b64ba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:00.249274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:00.294530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 578/1168] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:19:00.316727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d5272-157f-4fdb-80e1-feb743e95df4 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:00.419028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d5272-157f-4fdb-80e1-feb743e95df4 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:00.435713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:00.452614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0eec0-3c68-4e6b-8967-9fa6fad712a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:00.453340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0eec0-3c68-4e6b-8967-9fa6fad712a3 None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:00.453582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0eec0-3c68-4e6b-8967-9fa6fad712a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:00.453853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0eec0-3c68-4e6b-8967-9fa6fad712a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:00.454632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0eec0-3c68-4e6b-8967-9fa6fad712a3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:00.455924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0eec0-3c68-4e6b-8967-9fa6fad712a3 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:00.535758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 591/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Thu Jun 16 17:19:00 2022] POST /identity/v3/domains => generated 267 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:19:02.756726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f78af5-483c-48ad-9b2a-07b91c0c0eed None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:02.757280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f78af5-483c-48ad-9b2a-07b91c0c0eed None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:02.757280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f78af5-483c-48ad-9b2a-07b91c0c0eed None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:02.758611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 579/1170] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:02.764104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9d24d-f53d-4f33-a2b3-aa78d92f3201 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:02.764543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9d24d-f53d-4f33-a2b3-aa78d92f3201 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:02.764702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9d24d-f53d-4f33-a2b3-aa78d92f3201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:02.782187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-0cd9d24d-f53d-4f33-a2b3-aa78d92f3201 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:02.783444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0cd9d24d-f53d-4f33-a2b3-aa78d92f3201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:02.854415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 592/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:19:02.880401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f78af5-483c-48ad-9b2a-07b91c0c0eed None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:02.981911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f78af5-483c-48ad-9b2a-07b91c0c0eed None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:03.015612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493ecdf-a456-4a5c-aede-80b38787cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:03.016500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ecdf-a456-4a5c-aede-80b38787cdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:03.016783 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ecdf-a456-4a5c-aede-80b38787cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:03.017057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ecdf-a456-4a5c-aede-80b38787cdd1 None admin] PATH_INFO: `/v3/domains/51e2e5e134dd47499e1af4c25de9ba64` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:03.027666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493ecdf-a456-4a5c-aede-80b38787cdd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=51e2e5e134dd47499e1af4c25de9ba64)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:03.029125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493ecdf-a456-4a5c-aede-80b38787cdd1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:03.030726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 580/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Thu Jun 16 17:19:02 2022] GET /identity/v3/domains/51e2e5e134dd47499e1af4c25de9ba64 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:03.036578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9d24d-f53d-4f33-a2b3-aa78d92f3201 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:03.137572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9d24d-f53d-4f33-a2b3-aa78d92f3201 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:03.147038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:03.170409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a632024-c3a6-44d3-bd6f-dedc88513cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:03.171059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a632024-c3a6-44d3-bd6f-dedc88513cfb None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:03.171337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a632024-c3a6-44d3-bd6f-dedc88513cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:03.171608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a632024-c3a6-44d3-bd6f-dedc88513cfb None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:03.172337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a632024-c3a6-44d3-bd6f-dedc88513cfb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:03.173752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a632024-c3a6-44d3-bd6f-dedc88513cfb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:03.288748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 593/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:19:03 2022] POST /identity/v3/projects => generated 361 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:19:05.464674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170b2f4-9c5b-4b52-8472-b613e60fc042 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:05.465209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170b2f4-9c5b-4b52-8472-b613e60fc042 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:05.465209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170b2f4-9c5b-4b52-8472-b613e60fc042 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:05.466542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 581/1174] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:05.471671 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d962afd-a110-49c4-8fa6-ff7c30a380ac None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:05.472059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d962afd-a110-49c4-8fa6-ff7c30a380ac None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:05.472281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d962afd-a110-49c4-8fa6-ff7c30a380ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:05.490920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3d962afd-a110-49c4-8fa6-ff7c30a380ac None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:05.492248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3d962afd-a110-49c4-8fa6-ff7c30a380ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:05.562151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 594/1175] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:19:05.586158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170b2f4-9c5b-4b52-8472-b613e60fc042 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:05.605343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:05.688157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170b2f4-9c5b-4b52-8472-b613e60fc042 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:05.720467 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906754b-4cc5-4ec0-9c83-22324faea612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:05.721258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906754b-4cc5-4ec0-9c83-22324faea612 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:05.721541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906754b-4cc5-4ec0-9c83-22324faea612 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:05.721817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906754b-4cc5-4ec0-9c83-22324faea612 None admin] PATH_INFO: `/v3/domains/51e2e5e134dd47499e1af4c25de9ba64` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:05.722981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906754b-4cc5-4ec0-9c83-22324faea612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=51e2e5e134dd47499e1af4c25de9ba64)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:05.724980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906754b-4cc5-4ec0-9c83-22324faea612 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:05.726580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 582/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Thu Jun 16 17:19:05 2022] GET /identity/v3/domains/51e2e5e134dd47499e1af4c25de9ba64 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:05.732404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d962afd-a110-49c4-8fa6-ff7c30a380ac None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:05.818403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:05.827313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d962afd-a110-49c4-8fa6-ff7c30a380ac None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:05.861047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870497c7-4e02-452d-a755-969ca3180ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:05.861715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870497c7-4e02-452d-a755-969ca3180ebe None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:05.862001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870497c7-4e02-452d-a755-969ca3180ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:05.862281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870497c7-4e02-452d-a755-969ca3180ebe None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:05.862992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870497c7-4e02-452d-a755-969ca3180ebe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:05.864451 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870497c7-4e02-452d-a755-969ca3180ebe None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:05.986173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 595/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:19:05 2022] POST /identity/v3/users => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:19:08.134254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6913fd-3707-47a8-bb37-fa9282a9783c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:08.135078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6913fd-3707-47a8-bb37-fa9282a9783c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:08.135078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6913fd-3707-47a8-bb37-fa9282a9783c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:08.136448 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 583/1178] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:08.141611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5686e07-cae1-4331-a733-2468de2ae741 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:08.142024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5686e07-cae1-4331-a733-2468de2ae741 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:08.142161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5686e07-cae1-4331-a733-2468de2ae741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:08.158502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-c5686e07-cae1-4331-a733-2468de2ae741 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:08.159667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c5686e07-cae1-4331-a733-2468de2ae741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:08.224372 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 596/1179] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:19:08.247543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6913fd-3707-47a8-bb37-fa9282a9783c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:08.331908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:08.350218 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6913fd-3707-47a8-bb37-fa9282a9783c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:08.384398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c31c18-2cfc-4deb-832a-6da6eb6944d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:08.385394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c31c18-2cfc-4deb-832a-6da6eb6944d4 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:08.385680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c31c18-2cfc-4deb-832a-6da6eb6944d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:08.385958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c31c18-2cfc-4deb-832a-6da6eb6944d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:08.395881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c31c18-2cfc-4deb-832a-6da6eb6944d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-f8c31c18-2cfc-4deb-832a-6da6eb6944d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:19:08.403981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:19:08.405112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:19:08.406151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 584/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:19:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:19:08.411411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5686e07-cae1-4331-a733-2468de2ae741 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:08.485435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:08.508266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5686e07-cae1-4331-a733-2468de2ae741 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:08.542108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9b8f0-8793-4895-8ef6-f3e30f344f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:08.542768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b8f0-8793-4895-8ef6-f3e30f344f3b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:08.543052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b8f0-8793-4895-8ef6-f3e30f344f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:08.543325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b8f0-8793-4895-8ef6-f3e30f344f3b None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:08.544057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9b8f0-8793-4895-8ef6-f3e30f344f3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:19:08.544393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9b8f0-8793-4895-8ef6-f3e30f344f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:08.545838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9b8f0-8793-4895-8ef6-f3e30f344f3b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:08.554577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 597/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:19:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:08.560639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c31c18-2cfc-4deb-832a-6da6eb6944d4 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:08.663402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c31c18-2cfc-4deb-832a-6da6eb6944d4 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:08.696726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b419-8a9c-40b6-bf03-afd98324bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:08.697624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b419-8a9c-40b6-bf03-afd98324bb9a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:08.697911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b419-8a9c-40b6-bf03-afd98324bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:08.698188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b419-8a9c-40b6-bf03-afd98324bb9a None admin] PATH_INFO: `/v3/users/ea1be2e02e554e668fd7e6ededb5ae2c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:08.712122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b419-8a9c-40b6-bf03-afd98324bb9a None admin] RBAC: Authorizing `identity:get_user(user_id=ea1be2e02e554e668fd7e6ededb5ae2c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:08.713568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b419-8a9c-40b6-bf03-afd98324bb9a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:08.715223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 585/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:19:08 2022] GET /identity/v3/users/ea1be2e02e554e668fd7e6ededb5ae2c => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:08.720905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9b8f0-8793-4895-8ef6-f3e30f344f3b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:08.818544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9b8f0-8793-4895-8ef6-f3e30f344f3b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:08.851861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8dba4-dbcf-488a-93dd-ec2be143f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:08.852520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8dba4-dbcf-488a-93dd-ec2be143f369 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:08.852807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8dba4-dbcf-488a-93dd-ec2be143f369 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:08.853086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8dba4-dbcf-488a-93dd-ec2be143f369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:08.862045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:08.918524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8dba4-dbcf-488a-93dd-ec2be143f369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:08.919888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8dba4-dbcf-488a-93dd-ec2be143f369 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:09.015865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 598/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:19:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:19:09.021765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b419-8a9c-40b6-bf03-afd98324bb9a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:09.024760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:09.122432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b419-8a9c-40b6-bf03-afd98324bb9a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:09.155557 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9abf5-71c9-4e8c-8356-4df6b767353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:09.156441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9abf5-71c9-4e8c-8356-4df6b767353b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:09.156722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9abf5-71c9-4e8c-8356-4df6b767353b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:09.156995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9abf5-71c9-4e8c-8356-4df6b767353b None admin] PATH_INFO: `/v3/projects/021bbdb3835e4c97b0fa24770daa9505` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:09.158158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9abf5-71c9-4e8c-8356-4df6b767353b None admin] RBAC: Authorizing `identity:get_project(project_id=021bbdb3835e4c97b0fa24770daa9505)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:09.159573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9abf5-71c9-4e8c-8356-4df6b767353b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:09.161292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 586/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:19:09 2022] GET /identity/v3/projects/021bbdb3835e4c97b0fa24770daa9505 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:09.167906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8dba4-dbcf-488a-93dd-ec2be143f369 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:09.206695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:09.264208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8dba4-dbcf-488a-93dd-ec2be143f369 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:09.297008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8b1f5-374e-4780-89c6-8bf7d843abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:09.297652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8b1f5-374e-4780-89c6-8bf7d843abbc None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:09.297937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8b1f5-374e-4780-89c6-8bf7d843abbc None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:09.298214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8b1f5-374e-4780-89c6-8bf7d843abbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:09.299023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8b1f5-374e-4780-89c6-8bf7d843abbc None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=021bbdb3835e4c97b0fa24770daa9505, user.id=ea1be2e02e554e668fd7e6ededb5ae2c) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:19:09.299333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8b1f5-374e-4780-89c6-8bf7d843abbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:09.300780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8b1f5-374e-4780-89c6-8bf7d843abbc None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:09.306714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 599/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:19:09 2022] GET /identity/v3/role_assignments?user.id=ea1be2e02e554e668fd7e6ededb5ae2c&scope.project.id=021bbdb3835e4c97b0fa24770daa9505&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:11.399989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321d9c1-3b34-40f7-b1b9-33a2dbb59925 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:11.400584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321d9c1-3b34-40f7-b1b9-33a2dbb59925 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:11.400584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321d9c1-3b34-40f7-b1b9-33a2dbb59925 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:11.401903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 587/1186] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:11.406979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d25e-7dcd-41cd-afa1-348cedf66ead None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:11.407406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d25e-7dcd-41cd-afa1-348cedf66ead None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:11.407535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d25e-7dcd-41cd-afa1-348cedf66ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:11.424562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6773d25e-7dcd-41cd-afa1-348cedf66ead None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:11.425729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6773d25e-7dcd-41cd-afa1-348cedf66ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:11.490885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 600/1187] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:19:11.514342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321d9c1-3b34-40f7-b1b9-33a2dbb59925 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:11.584259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:11.615982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321d9c1-3b34-40f7-b1b9-33a2dbb59925 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:11.651390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e36d5-ec10-4d9a-9648-bed1864277e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:11.652145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e36d5-ec10-4d9a-9648-bed1864277e9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:11.652436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e36d5-ec10-4d9a-9648-bed1864277e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:11.652716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e36d5-ec10-4d9a-9648-bed1864277e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:11.663211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e36d5-ec10-4d9a-9648-bed1864277e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-692e36d5-ec10-4d9a-9648-bed1864277e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:19:11.670792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:19:11.672001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:19:11.672984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 588/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:19:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:19:11.678338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773d25e-7dcd-41cd-afa1-348cedf66ead None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:11.707885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:11.775719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773d25e-7dcd-41cd-afa1-348cedf66ead None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:11.809447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a159992-81e2-4521-a36b-ef6f4fac2215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:11.810115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159992-81e2-4521-a36b-ef6f4fac2215 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:11.810398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159992-81e2-4521-a36b-ef6f4fac2215 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:11.810676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159992-81e2-4521-a36b-ef6f4fac2215 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:11.811408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a159992-81e2-4521-a36b-ef6f4fac2215 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:19:11.811714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a159992-81e2-4521-a36b-ef6f4fac2215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:11.813107 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a159992-81e2-4521-a36b-ef6f4fac2215 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:11.821199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 601/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:19:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:11.826979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e36d5-ec10-4d9a-9648-bed1864277e9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:11.925898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e36d5-ec10-4d9a-9648-bed1864277e9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:11.952805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:11.959069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb047db-9a43-4a3f-baa3-f3abe34cdeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:11.959907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb047db-9a43-4a3f-baa3-f3abe34cdeab None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:11.966744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb047db-9a43-4a3f-baa3-f3abe34cdeab None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:11.966744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb047db-9a43-4a3f-baa3-f3abe34cdeab None admin] PATH_INFO: `/v3/users/ea1be2e02e554e668fd7e6ededb5ae2c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:11.966744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb047db-9a43-4a3f-baa3-f3abe34cdeab None admin] RBAC: Authorizing `identity:get_user(user_id=ea1be2e02e554e668fd7e6ededb5ae2c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:11.966744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb047db-9a43-4a3f-baa3-f3abe34cdeab None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:11.966744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 589/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:19:11 2022] GET /identity/v3/users/ea1be2e02e554e668fd7e6ededb5ae2c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:11.970478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a159992-81e2-4521-a36b-ef6f4fac2215 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:12.060672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:12.067187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a159992-81e2-4521-a36b-ef6f4fac2215 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:12.100491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550a520-a38b-4628-b684-a776025f380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:12.101642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550a520-a38b-4628-b684-a776025f380c None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:12.102083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550a520-a38b-4628-b684-a776025f380c None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:12.102705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550a520-a38b-4628-b684-a776025f380c None admin] PATH_INFO: `/v3/projects/021bbdb3835e4c97b0fa24770daa9505` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:12.103892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550a520-a38b-4628-b684-a776025f380c None admin] RBAC: Authorizing `identity:get_project(project_id=021bbdb3835e4c97b0fa24770daa9505)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:12.105339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550a520-a38b-4628-b684-a776025f380c None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:12.107030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 602/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:19:11 2022] GET /identity/v3/projects/021bbdb3835e4c97b0fa24770daa9505 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:12.112986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb047db-9a43-4a3f-baa3-f3abe34cdeab None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:12.212182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb047db-9a43-4a3f-baa3-f3abe34cdeab None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:12.245776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560d116-aaaf-4ce1-90cf-87749ba7c8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:12.246685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d116-aaaf-4ce1-90cf-87749ba7c8ee None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:12.246961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d116-aaaf-4ce1-90cf-87749ba7c8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:12.247230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d116-aaaf-4ce1-90cf-87749ba7c8ee None admin] PATH_INFO: `/v3/projects/021bbdb3835e4c97b0fa24770daa9505/users/ea1be2e02e554e668fd7e6ededb5ae2c/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:12.249308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560d116-aaaf-4ce1-90cf-87749ba7c8ee None admin] RBAC: Authorizing `identity:create_grant(project_id=021bbdb3835e4c97b0fa24770daa9505, user_id=ea1be2e02e554e668fd7e6ededb5ae2c, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:12.250727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560d116-aaaf-4ce1-90cf-87749ba7c8ee None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:12.345367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 590/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:19:12 2022] PUT /identity/v3/projects/021bbdb3835e4c97b0fa24770daa9505/users/ea1be2e02e554e668fd7e6ededb5ae2c/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:19:14.472537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe550-85fc-4deb-80da-6c747351e48e None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:14.473067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe550-85fc-4deb-80da-6c747351e48e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:14.473162 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe550-85fc-4deb-80da-6c747351e48e None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:14.475462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 603/1193] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:19:14.480674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6257-207f-463e-9831-4f6363457ba0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:14.481110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6257-207f-463e-9831-4f6363457ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:14.481232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6257-207f-463e-9831-4f6363457ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:14.498201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8c5c6257-207f-463e-9831-4f6363457ba0 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:19:14.499382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8c5c6257-207f-463e-9831-4f6363457ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:19:14.551089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:14.565303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 591/1194] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:19:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:19:14.588638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebe550-85fc-4deb-80da-6c747351e48e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:14.691043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebe550-85fc-4deb-80da-6c747351e48e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:14.723122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921c356-f3a5-420d-b747-d218c2260a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:14.724465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921c356-f3a5-420d-b747-d218c2260a4f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:14.724745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921c356-f3a5-420d-b747-d218c2260a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:14.725018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921c356-f3a5-420d-b747-d218c2260a4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:14.735232 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921c356-f3a5-420d-b747-d218c2260a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-2921c356-f3a5-420d-b747-d218c2260a4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:19:14.743009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:19:14.744142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:19:14.745198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:19:14.748225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 604/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:19:14.750232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c6257-207f-463e-9831-4f6363457ba0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:14.846719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c6257-207f-463e-9831-4f6363457ba0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:14.879580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154bcb4-c932-46f2-abce-bbee54522e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:14.880387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154bcb4-c932-46f2-abce-bbee54522e77 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:14.880673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154bcb4-c932-46f2-abce-bbee54522e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:14.880946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154bcb4-c932-46f2-abce-bbee54522e77 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:14.881674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154bcb4-c932-46f2-abce-bbee54522e77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:19:14.881979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154bcb4-c932-46f2-abce-bbee54522e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:14.883334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154bcb4-c932-46f2-abce-bbee54522e77 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:14.891512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 592/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:19:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:14.898256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921c356-f3a5-420d-b747-d218c2260a4f None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:14.923218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:14.997462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921c356-f3a5-420d-b747-d218c2260a4f None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:15.030788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf10e4-0fa7-46b9-ac9f-9acf65a2d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:15.031648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf10e4-0fa7-46b9-ac9f-9acf65a2d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:15.031929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf10e4-0fa7-46b9-ac9f-9acf65a2d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:15.032234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf10e4-0fa7-46b9-ac9f-9acf65a2d6c9 None admin] PATH_INFO: `/v3/users/ea1be2e02e554e668fd7e6ededb5ae2c` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:15.033403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf10e4-0fa7-46b9-ac9f-9acf65a2d6c9 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1be2e02e554e668fd7e6ededb5ae2c)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:15.034822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf10e4-0fa7-46b9-ac9f-9acf65a2d6c9 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:15.037226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 605/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Thu Jun 16 17:19:14 2022] GET /identity/v3/users/ea1be2e02e554e668fd7e6ededb5ae2c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:15.042980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154bcb4-c932-46f2-abce-bbee54522e77 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:15.093395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:15.142807 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154bcb4-c932-46f2-abce-bbee54522e77 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:15.175808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4de8c7-84d9-4cda-bb1b-f113bf15626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:15.176489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de8c7-84d9-4cda-bb1b-f113bf15626e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:15.176840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de8c7-84d9-4cda-bb1b-f113bf15626e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:15.177303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de8c7-84d9-4cda-bb1b-f113bf15626e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:15.243563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4de8c7-84d9-4cda-bb1b-f113bf15626e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:15.245043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4de8c7-84d9-4cda-bb1b-f113bf15626e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:15.293536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:15.342957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 593/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:19:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:19:15.349124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf10e4-0fa7-46b9-ac9f-9acf65a2d6c9 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:15.440773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:15.451187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf10e4-0fa7-46b9-ac9f-9acf65a2d6c9 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:15.485010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579e876-cba2-444e-80b9-02effc825677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:15.485884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e876-cba2-444e-80b9-02effc825677 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:15.486174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e876-cba2-444e-80b9-02effc825677 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:15.486454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e876-cba2-444e-80b9-02effc825677 None admin] PATH_INFO: `/v3/projects/021bbdb3835e4c97b0fa24770daa9505` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:15.487641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579e876-cba2-444e-80b9-02effc825677 None admin] RBAC: Authorizing `identity:get_project(project_id=021bbdb3835e4c97b0fa24770daa9505)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:15.489099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579e876-cba2-444e-80b9-02effc825677 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:15.491539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 606/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Thu Jun 16 17:19:15 2022] GET /identity/v3/projects/021bbdb3835e4c97b0fa24770daa9505 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:15.499088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4de8c7-84d9-4cda-bb1b-f113bf15626e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:19:15.595963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4de8c7-84d9-4cda-bb1b-f113bf15626e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:19:15.628973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e2b8-556e-4fd8-8614-a66d85c533e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:19:15.629623 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e2b8-556e-4fd8-8614-a66d85c533e6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:19:15.629980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e2b8-556e-4fd8-8614-a66d85c533e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:19:15.630258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e2b8-556e-4fd8-8614-a66d85c533e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:19:15.631066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e2b8-556e-4fd8-8614-a66d85c533e6 None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=021bbdb3835e4c97b0fa24770daa9505, user.id=ea1be2e02e554e668fd7e6ededb5ae2c) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:19:15.631374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e2b8-556e-4fd8-8614-a66d85c533e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:19:15.632818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e2b8-556e-4fd8-8614-a66d85c533e6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:19:15.638737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 594/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:19:15 2022] GET /identity/v3/role_assignments?user.id=ea1be2e02e554e668fd7e6ededb5ae2c&scope.project.id=021bbdb3835e4c97b0fa24770daa9505&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:19:25.482177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=21 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:19:25.636180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=93 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:42.440082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd0876-74a3-45b1-95e6-cc0ee41b01be None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:42.440757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd0876-74a3-45b1-95e6-cc0ee41b01be None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:42.440757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd0876-74a3-45b1-95e6-cc0ee41b01be None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:42.441994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 607/1201] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:20:42.447203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de6f18-a859-49fc-8a31-0b9e08e50d9e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:42.447645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de6f18-a859-49fc-8a31-0b9e08e50d9e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:42.447776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de6f18-a859-49fc-8a31-0b9e08e50d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:42.464958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-79de6f18-a859-49fc-8a31-0b9e08e50d9e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:20:42.466168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-79de6f18-a859-49fc-8a31-0b9e08e50d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:20:42.536117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 595/1202] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:20:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 17:20:42.560127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd0876-74a3-45b1-95e6-cc0ee41b01be None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:42.663013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd0876-74a3-45b1-95e6-cc0ee41b01be None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:42.698150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ac70f-0fa9-4894-a797-0d05c468a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:42.698902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ac70f-0fa9-4894-a797-0d05c468a188 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:42.699188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ac70f-0fa9-4894-a797-0d05c468a188 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:42.699466 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ac70f-0fa9-4894-a797-0d05c468a188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:42.710210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ac70f-0fa9-4894-a797-0d05c468a188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:42.711733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ac70f-0fa9-4894-a797-0d05c468a188 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-b34ac70f-0fa9-4894-a797-0d05c468a188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:20:42.730271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:42.731431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:42.732656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:20:42.732656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:20:42.732656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:42.732656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:20:42.732656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 608/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:42.737773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de6f18-a859-49fc-8a31-0b9e08e50d9e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:42.837087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de6f18-a859-49fc-8a31-0b9e08e50d9e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:42.864830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:42.870499 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11258-bffe-47e8-a159-e3f1fa8c7dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:42.871159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11258-bffe-47e8-a159-e3f1fa8c7dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:42.871442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11258-bffe-47e8-a159-e3f1fa8c7dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:42.871718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11258-bffe-47e8-a159-e3f1fa8c7dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:42.872454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec11258-bffe-47e8-a159-e3f1fa8c7dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:42.872761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec11258-bffe-47e8-a159-e3f1fa8c7dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:42.874127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec11258-bffe-47e8-a159-e3f1fa8c7dc0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:42.885772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 596/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:42.892304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ac70f-0fa9-4894-a797-0d05c468a188 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:42.944668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:42.991478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ac70f-0fa9-4894-a797-0d05c468a188 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:43.024891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963568e-ce39-4fa9-96ce-589e61a188bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:43.025554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963568e-ce39-4fa9-96ce-589e61a188bd None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:43.025839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963568e-ce39-4fa9-96ce-589e61a188bd None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:43.026116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963568e-ce39-4fa9-96ce-589e61a188bd None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:43.026807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963568e-ce39-4fa9-96ce-589e61a188bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:43.028252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963568e-ce39-4fa9-96ce-589e61a188bd None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:43.234276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 609/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Thu Jun 16 17:20:42 2022] POST /identity/v3/users => generated 251 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:20:45.489968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2189bc3-314d-48f9-9605-f0ea2fc5d01f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:45.490534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2189bc3-314d-48f9-9605-f0ea2fc5d01f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:45.490534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2189bc3-314d-48f9-9605-f0ea2fc5d01f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:45.491845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 597/1206] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:20:45.496996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f393c-0cbc-4ec9-830d-dd8af7e17260 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:45.497393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f393c-0cbc-4ec9-830d-dd8af7e17260 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:45.497565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f393c-0cbc-4ec9-830d-dd8af7e17260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:45.515162 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9b0f393c-0cbc-4ec9-830d-dd8af7e17260 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:20:45.521815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9b0f393c-0cbc-4ec9-830d-dd8af7e17260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:20:45.587564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 610/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:20:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:20:45.610825 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2189bc3-314d-48f9-9605-f0ea2fc5d01f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:45.713168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2189bc3-314d-48f9-9605-f0ea2fc5d01f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:45.746019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd0ae3-13e0-49dc-85f1-61bb6220bc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:45.746794 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd0ae3-13e0-49dc-85f1-61bb6220bc2c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:45.747073 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd0ae3-13e0-49dc-85f1-61bb6220bc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:45.747345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd0ae3-13e0-49dc-85f1-61bb6220bc2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:45.758907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd0ae3-13e0-49dc-85f1-61bb6220bc2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-56cd0ae3-13e0-49dc-85f1-61bb6220bc2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:20:45.767041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:45.768534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:45.769536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 598/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:20:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:45.774525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f393c-0cbc-4ec9-830d-dd8af7e17260 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:45.815594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:45.875946 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f393c-0cbc-4ec9-830d-dd8af7e17260 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:45.910256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056a784-b265-4e86-ae19-d9fa6f66bd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:45.912849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056a784-b265-4e86-ae19-d9fa6f66bd6a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:45.912849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056a784-b265-4e86-ae19-d9fa6f66bd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:45.912849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056a784-b265-4e86-ae19-d9fa6f66bd6a None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:45.912849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056a784-b265-4e86-ae19-d9fa6f66bd6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:45.912849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056a784-b265-4e86-ae19-d9fa6f66bd6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:45.913955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056a784-b265-4e86-ae19-d9fa6f66bd6a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:45.921709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 611/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:20:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:45.928404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd0ae3-13e0-49dc-85f1-61bb6220bc2c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:45.979403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:46.028740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd0ae3-13e0-49dc-85f1-61bb6220bc2c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:46.064399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709443e-287e-409c-ba26-51413295f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:46.065195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709443e-287e-409c-ba26-51413295f3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:46.065488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709443e-287e-409c-ba26-51413295f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:46.065821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709443e-287e-409c-ba26-51413295f3c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:46.075830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709443e-287e-409c-ba26-51413295f3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:46.077337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709443e-287e-409c-ba26-51413295f3c6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7709443e-287e-409c-ba26-51413295f3c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:20:46.095154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:46.100658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:46.101864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:20:46.101864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:20:46.101864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:46.101864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:46.101864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 599/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:46.102317 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056a784-b265-4e86-ae19-d9fa6f66bd6a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:46.206963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:46.209975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056a784-b265-4e86-ae19-d9fa6f66bd6a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:46.243871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ee9e1-b0d7-4e8f-94b2-8ab3b732bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:46.244558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ee9e1-b0d7-4e8f-94b2-8ab3b732bffa None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:46.244840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ee9e1-b0d7-4e8f-94b2-8ab3b732bffa None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:46.245113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ee9e1-b0d7-4e8f-94b2-8ab3b732bffa None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:46.245813 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ee9e1-b0d7-4e8f-94b2-8ab3b732bffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:46.246118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ee9e1-b0d7-4e8f-94b2-8ab3b732bffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:46.247472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ee9e1-b0d7-4e8f-94b2-8ab3b732bffa None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:46.259716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 612/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:46.265604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709443e-287e-409c-ba26-51413295f3c6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:46.363024 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709443e-287e-409c-ba26-51413295f3c6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:46.364491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:46.396620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a8a1b-4045-423a-879f-4fb407faced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:46.397414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a8a1b-4045-423a-879f-4fb407faced6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:46.397694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a8a1b-4045-423a-879f-4fb407faced6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:46.397966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a8a1b-4045-423a-879f-4fb407faced6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:46.404755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a8a1b-4045-423a-879f-4fb407faced6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:46.406178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a8a1b-4045-423a-879f-4fb407faced6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-dd6a8a1b-4045-423a-879f-4fb407faced6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:20:46.420962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:46.422834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:46.423889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 600/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:46.428999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ee9e1-b0d7-4e8f-94b2-8ab3b732bffa None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:46.532702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ee9e1-b0d7-4e8f-94b2-8ab3b732bffa None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:46.569178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dac4e-889e-4d68-b8ed-5e88b44b494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:46.569899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dac4e-889e-4d68-b8ed-5e88b44b494a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:46.570188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dac4e-889e-4d68-b8ed-5e88b44b494a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:46.570472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dac4e-889e-4d68-b8ed-5e88b44b494a None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:46.571362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dac4e-889e-4d68-b8ed-5e88b44b494a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:46.571680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dac4e-889e-4d68-b8ed-5e88b44b494a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:46.573185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dac4e-889e-4d68-b8ed-5e88b44b494a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:46.590514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 613/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Jun 16 17:20:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:46.596948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a8a1b-4045-423a-879f-4fb407faced6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:46.698534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a8a1b-4045-423a-879f-4fb407faced6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:46.732507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f33f21-7eae-4a21-a3dc-4866d8e1d04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:46.733148 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33f21-7eae-4a21-a3dc-4866d8e1d04d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:46.733428 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33f21-7eae-4a21-a3dc-4866d8e1d04d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:46.733699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33f21-7eae-4a21-a3dc-4866d8e1d04d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:46.763317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:46.800595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f33f21-7eae-4a21-a3dc-4866d8e1d04d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:46.802042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f33f21-7eae-4a21-a3dc-4866d8e1d04d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:46.900709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 601/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:20:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:20:46.907186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dac4e-889e-4d68-b8ed-5e88b44b494a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:46.927856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:47.013669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dac4e-889e-4d68-b8ed-5e88b44b494a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:47.049161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0ad84-0111-4d08-92fe-4983f9bff6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:47.049821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ad84-0111-4d08-92fe-4983f9bff6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:47.050101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ad84-0111-4d08-92fe-4983f9bff6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:47.050371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ad84-0111-4d08-92fe-4983f9bff6b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:47.060046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0ad84-0111-4d08-92fe-4983f9bff6b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:47.061506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0ad84-0111-4d08-92fe-4983f9bff6b7 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-e2c0ad84-0111-4d08-92fe-4983f9bff6b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:20:47.079160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:47.080335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:47.081486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:20:47.081486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:20:47.081486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:47.081486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:20:47.081486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 614/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:47.086021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f33f21-7eae-4a21-a3dc-4866d8e1d04d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:47.146137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:47.182995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f33f21-7eae-4a21-a3dc-4866d8e1d04d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:47.216373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298255f-553f-45d5-a11b-216d17cee3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:47.217032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298255f-553f-45d5-a11b-216d17cee3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:47.217312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298255f-553f-45d5-a11b-216d17cee3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:47.217582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298255f-553f-45d5-a11b-216d17cee3d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:47.218277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298255f-553f-45d5-a11b-216d17cee3d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:47.218576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298255f-553f-45d5-a11b-216d17cee3d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:47.220039 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298255f-553f-45d5-a11b-216d17cee3d7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:47.230795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 602/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:47.236974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0ad84-0111-4d08-92fe-4983f9bff6b7 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:47.308619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:47.338692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0ad84-0111-4d08-92fe-4983f9bff6b7 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:47.372878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec47c9-7c02-4807-8fcb-d8c3552d4bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:47.373669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec47c9-7c02-4807-8fcb-d8c3552d4bea None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:47.373951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec47c9-7c02-4807-8fcb-d8c3552d4bea None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:47.374229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec47c9-7c02-4807-8fcb-d8c3552d4bea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:47.381118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec47c9-7c02-4807-8fcb-d8c3552d4bea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:47.382548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec47c9-7c02-4807-8fcb-d8c3552d4bea None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-0bec47c9-7c02-4807-8fcb-d8c3552d4bea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:20:47.395991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:47.397150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:47.398231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:20:47.398231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:20:47.398231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:20:47.398231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:20:47.398231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:20:47.398231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:20:47.398231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:20:47.398231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:20:47.398231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 615/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:20:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:47.403176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298255f-553f-45d5-a11b-216d17cee3d7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:47.502735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298255f-553f-45d5-a11b-216d17cee3d7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:47.524882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:47.537964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e3809-7515-4ceb-ab1d-9c25747698a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:47.538626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e3809-7515-4ceb-ab1d-9c25747698a6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:47.538984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e3809-7515-4ceb-ab1d-9c25747698a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:47.539272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e3809-7515-4ceb-ab1d-9c25747698a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:47.540122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e3809-7515-4ceb-ab1d-9c25747698a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:47.540440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e3809-7515-4ceb-ab1d-9c25747698a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:47.541874 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e3809-7515-4ceb-ab1d-9c25747698a6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:47.554745 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 603/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:20:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:47.561032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec47c9-7c02-4807-8fcb-d8c3552d4bea None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:47.665115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec47c9-7c02-4807-8fcb-d8c3552d4bea None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:47.692583 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:47.698199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8cab3-7da5-413f-ab90-badf3092da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:47.698876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8cab3-7da5-413f-ab90-badf3092da2f None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:47.699157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8cab3-7da5-413f-ab90-badf3092da2f None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:47.699429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8cab3-7da5-413f-ab90-badf3092da2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:47.700430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8cab3-7da5-413f-ab90-badf3092da2f None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=a2909d4015ac45fcaf6d1fc8e488aa44) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:47.700749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8cab3-7da5-413f-ab90-badf3092da2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:47.702188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8cab3-7da5-413f-ab90-badf3092da2f None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:47.708718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 616/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:20:47 2022] GET /identity/v3/role_assignments?user.id=a2909d4015ac45fcaf6d1fc8e488aa44&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:20:49.808457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8e99-2ce9-4755-8de6-d627ed4177dd None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:49.809001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8e99-2ce9-4755-8de6-d627ed4177dd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:49.809001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8e99-2ce9-4755-8de6-d627ed4177dd None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:49.810369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 604/1220] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:20:49.815713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45428a0-d83e-4455-a44c-ca780434542c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:49.816143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45428a0-d83e-4455-a44c-ca780434542c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:49.816310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45428a0-d83e-4455-a44c-ca780434542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:49.832909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-e45428a0-d83e-4455-a44c-ca780434542c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:20:49.834029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e45428a0-d83e-4455-a44c-ca780434542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:20:49.900761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 617/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:20:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:20:49.924032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8e99-2ce9-4755-8de6-d627ed4177dd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:50.025020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8e99-2ce9-4755-8de6-d627ed4177dd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:50.058213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17588396-5532-4e94-8077-83ef09bb8f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:50.059002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588396-5532-4e94-8077-83ef09bb8f8e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:50.059283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588396-5532-4e94-8077-83ef09bb8f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:50.059555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588396-5532-4e94-8077-83ef09bb8f8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:50.070317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17588396-5532-4e94-8077-83ef09bb8f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-17588396-5532-4e94-8077-83ef09bb8f8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:20:50.078611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:50.080238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:50.081978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 605/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:20:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:50.086261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45428a0-d83e-4455-a44c-ca780434542c None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:50.191614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45428a0-d83e-4455-a44c-ca780434542c None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:50.216735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:50.228320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b15f1-20fc-42b3-8e3d-a269a0f9017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:50.229022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b15f1-20fc-42b3-8e3d-a269a0f9017d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:50.229306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b15f1-20fc-42b3-8e3d-a269a0f9017d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:50.229582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b15f1-20fc-42b3-8e3d-a269a0f9017d None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:50.230318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b15f1-20fc-42b3-8e3d-a269a0f9017d None admin] RBAC: Adding query filter params (name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:50.230627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b15f1-20fc-42b3-8e3d-a269a0f9017d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:50.232023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b15f1-20fc-42b3-8e3d-a269a0f9017d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:50.240505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 618/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:20:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:50.246378 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17588396-5532-4e94-8077-83ef09bb8f8e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:50.296562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:50.352742 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17588396-5532-4e94-8077-83ef09bb8f8e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:50.385295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971202ce-674f-40b4-a151-0d30452913c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:50.386091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971202ce-674f-40b4-a151-0d30452913c3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:50.386373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971202ce-674f-40b4-a151-0d30452913c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:50.386645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971202ce-674f-40b4-a151-0d30452913c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:50.397569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971202ce-674f-40b4-a151-0d30452913c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:50.408376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971202ce-674f-40b4-a151-0d30452913c3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-971202ce-674f-40b4-a151-0d30452913c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:20:50.415654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:50.416702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:50.417645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:20:50.417645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:20:50.417645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:50.417645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:50.417645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 606/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:50.423084 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b15f1-20fc-42b3-8e3d-a269a0f9017d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:50.521724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b15f1-20fc-42b3-8e3d-a269a0f9017d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:50.555386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6042e23-31f4-4e7d-a25e-758999f28803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:50.556083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6042e23-31f4-4e7d-a25e-758999f28803 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:50.556376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6042e23-31f4-4e7d-a25e-758999f28803 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:50.556656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6042e23-31f4-4e7d-a25e-758999f28803 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:50.557402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6042e23-31f4-4e7d-a25e-758999f28803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:50.557713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6042e23-31f4-4e7d-a25e-758999f28803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:50.559098 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6042e23-31f4-4e7d-a25e-758999f28803 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:50.572000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 619/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:50.586316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971202ce-674f-40b4-a151-0d30452913c3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:50.670950 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:50.678283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971202ce-674f-40b4-a151-0d30452913c3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:50.711741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580effaa-7f4d-4d54-b98e-65f970d86179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:50.712635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580effaa-7f4d-4d54-b98e-65f970d86179 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:50.712921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580effaa-7f4d-4d54-b98e-65f970d86179 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:50.713200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580effaa-7f4d-4d54-b98e-65f970d86179 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:50.720912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580effaa-7f4d-4d54-b98e-65f970d86179 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:50.724130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580effaa-7f4d-4d54-b98e-65f970d86179 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-580effaa-7f4d-4d54-b98e-65f970d86179 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:20:50.737116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:50.738211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:50.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:50.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:50.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:20:50.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:20:50.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:20:50.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:20:50.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:20:50.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:20:50.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:20:50.739358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:50.743180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 607/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:20:50.744321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6042e23-31f4-4e7d-a25e-758999f28803 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:50.790754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:50.842227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6042e23-31f4-4e7d-a25e-758999f28803 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:50.876085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837df3-3a06-49c2-af0a-c63fb7538da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:50.876761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837df3-3a06-49c2-af0a-c63fb7538da8 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:50.877043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837df3-3a06-49c2-af0a-c63fb7538da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:50.877320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837df3-3a06-49c2-af0a-c63fb7538da8 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:50.878136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837df3-3a06-49c2-af0a-c63fb7538da8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:50.878445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837df3-3a06-49c2-af0a-c63fb7538da8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:50.879861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837df3-3a06-49c2-af0a-c63fb7538da8 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:50.897256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 620/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Jun 16 17:20:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:50.902953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580effaa-7f4d-4d54-b98e-65f970d86179 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:51.004898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580effaa-7f4d-4d54-b98e-65f970d86179 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:51.038961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be609f32-1f64-4d71-840b-53b8c23e46e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:51.042935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be609f32-1f64-4d71-840b-53b8c23e46e5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:51.042935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be609f32-1f64-4d71-840b-53b8c23e46e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:51.042935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be609f32-1f64-4d71-840b-53b8c23e46e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:51.051241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be609f32-1f64-4d71-840b-53b8c23e46e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:51.052704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be609f32-1f64-4d71-840b-53b8c23e46e5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-be609f32-1f64-4d71-840b-53b8c23e46e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:20:51.069892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:51.070973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:51.071989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:20:51.071989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:20:51.071989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:51.071989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:51.071989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 608/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:51.076823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837df3-3a06-49c2-af0a-c63fb7538da8 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:51.176943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837df3-3a06-49c2-af0a-c63fb7538da8 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:51.179211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:51.209853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ec7e7-3114-4d73-8388-84aa0e42de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:51.210508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec7e7-3114-4d73-8388-84aa0e42de76 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:51.210788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec7e7-3114-4d73-8388-84aa0e42de76 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:51.211062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec7e7-3114-4d73-8388-84aa0e42de76 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:51.211761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ec7e7-3114-4d73-8388-84aa0e42de76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:51.212060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ec7e7-3114-4d73-8388-84aa0e42de76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:51.213443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ec7e7-3114-4d73-8388-84aa0e42de76 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:51.225070 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 621/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:51.230753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be609f32-1f64-4d71-840b-53b8c23e46e5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:51.240279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:51.331947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be609f32-1f64-4d71-840b-53b8c23e46e5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:51.369216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c5968-517f-495f-83b1-2eadf5bb7def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:51.370016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c5968-517f-495f-83b1-2eadf5bb7def None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:51.370302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c5968-517f-495f-83b1-2eadf5bb7def None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:51.370579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c5968-517f-495f-83b1-2eadf5bb7def None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:51.383343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c5968-517f-495f-83b1-2eadf5bb7def None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:51.392612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c5968-517f-495f-83b1-2eadf5bb7def None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b77c5968-517f-495f-83b1-2eadf5bb7def None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:20:51.400749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:51.401805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:51.402752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:20:51.402752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:20:51.402752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:20:51.402752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:20:51.402752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:20:51.402752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:20:51.402752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:20:51.402752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:51.402752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 609/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:51.407909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ec7e7-3114-4d73-8388-84aa0e42de76 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:51.506790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ec7e7-3114-4d73-8388-84aa0e42de76 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:51.540319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559e72e-07a7-4e89-af5d-15078fc55226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:51.540965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559e72e-07a7-4e89-af5d-15078fc55226 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:51.541249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559e72e-07a7-4e89-af5d-15078fc55226 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:51.541525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559e72e-07a7-4e89-af5d-15078fc55226 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:51.542288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559e72e-07a7-4e89-af5d-15078fc55226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:51.542597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559e72e-07a7-4e89-af5d-15078fc55226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:51.544016 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559e72e-07a7-4e89-af5d-15078fc55226 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:51.556759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 622/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:51.562809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c5968-517f-495f-83b1-2eadf5bb7def None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:51.629027 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:51.663526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c5968-517f-495f-83b1-2eadf5bb7def None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:51.695717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efd7df-db51-4b9a-95fe-bd73153bb24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:51.696624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efd7df-db51-4b9a-95fe-bd73153bb24b None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:51.696907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efd7df-db51-4b9a-95fe-bd73153bb24b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:51.697185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efd7df-db51-4b9a-95fe-bd73153bb24b None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/a2909d4015ac45fcaf6d1fc8e488aa44/roles/2e0782565f884df9ba31ae571e465e25` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:51.714087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efd7df-db51-4b9a-95fe-bd73153bb24b None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=a2909d4015ac45fcaf6d1fc8e488aa44, role_id=2e0782565f884df9ba31ae571e465e25)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:51.715663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efd7df-db51-4b9a-95fe-bd73153bb24b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:51.827443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 610/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:20:51 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/a2909d4015ac45fcaf6d1fc8e488aa44/roles/2e0782565f884df9ba31ae571e465e25 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:20:53.902459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f69c-019e-45ae-bfcf-8ea1a36b2268 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:53.902982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f69c-019e-45ae-bfcf-8ea1a36b2268 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:53.902982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f69c-019e-45ae-bfcf-8ea1a36b2268 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:53.904313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 623/1233] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:20:53.909592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e46b7-da7b-48ff-81ec-bd0b3c920afc None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:53.911610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e46b7-da7b-48ff-81ec-bd0b3c920afc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:53.911610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e46b7-da7b-48ff-81ec-bd0b3c920afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:53.927626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f16e46b7-da7b-48ff-81ec-bd0b3c920afc None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:20:53.928859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f16e46b7-da7b-48ff-81ec-bd0b3c920afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:20:53.997117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 611/1234] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:20:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:20:54.020711 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f69c-019e-45ae-bfcf-8ea1a36b2268 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:54.047101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:54.120816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f69c-019e-45ae-bfcf-8ea1a36b2268 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:54.154942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89db382-2d21-464d-991d-ac79eda8f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:54.155672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89db382-2d21-464d-991d-ac79eda8f21d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:54.155977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89db382-2d21-464d-991d-ac79eda8f21d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:54.156868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89db382-2d21-464d-991d-ac79eda8f21d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:54.166687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89db382-2d21-464d-991d-ac79eda8f21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-f89db382-2d21-464d-991d-ac79eda8f21d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:20:54.174439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:54.175651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:20:54.176968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 624/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Thu Jun 16 17:20:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:54.181646 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e46b7-da7b-48ff-81ec-bd0b3c920afc None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:54.227405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:54.278584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e46b7-da7b-48ff-81ec-bd0b3c920afc None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:54.310569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b038f1-0bfb-44c0-a915-868f2f1cb4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:54.313294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b038f1-0bfb-44c0-a915-868f2f1cb4ce None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:54.313294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b038f1-0bfb-44c0-a915-868f2f1cb4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:54.313294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b038f1-0bfb-44c0-a915-868f2f1cb4ce None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:54.313294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b038f1-0bfb-44c0-a915-868f2f1cb4ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:54.313676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b038f1-0bfb-44c0-a915-868f2f1cb4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:54.314770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b038f1-0bfb-44c0-a915-868f2f1cb4ce None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:54.323871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 612/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Thu Jun 16 17:20:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:54.330603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89db382-2d21-464d-991d-ac79eda8f21d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:54.420420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:54.436756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89db382-2d21-464d-991d-ac79eda8f21d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:54.470712 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6ce83-bbab-46e8-9606-c2a9ba00ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:54.471502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ce83-bbab-46e8-9606-c2a9ba00ac55 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:54.471780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ce83-bbab-46e8-9606-c2a9ba00ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:54.472051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ce83-bbab-46e8-9606-c2a9ba00ac55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:54.482266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6ce83-bbab-46e8-9606-c2a9ba00ac55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:54.483689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6ce83-bbab-46e8-9606-c2a9ba00ac55 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-e6a6ce83-bbab-46e8-9606-c2a9ba00ac55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:20:54.501110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:54.502339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:54.503408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:20:54.503408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:20:54.503408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:54.503408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:20:54.503408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 625/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:54.508456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b038f1-0bfb-44c0-a915-868f2f1cb4ce None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:54.612262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b038f1-0bfb-44c0-a915-868f2f1cb4ce None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:54.621799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:54.647899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fedba-8f25-42f7-8674-b3e0f69227d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:54.648603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fedba-8f25-42f7-8674-b3e0f69227d2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:54.648893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fedba-8f25-42f7-8674-b3e0f69227d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:54.649174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fedba-8f25-42f7-8674-b3e0f69227d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:54.649881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fedba-8f25-42f7-8674-b3e0f69227d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:54.650204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fedba-8f25-42f7-8674-b3e0f69227d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:54.651558 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fedba-8f25-42f7-8674-b3e0f69227d2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:54.663422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 613/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:54.669246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6ce83-bbab-46e8-9606-c2a9ba00ac55 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:54.769874 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6ce83-bbab-46e8-9606-c2a9ba00ac55 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:54.802494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001fdaa-1568-4ff7-a3cc-ed3a1a508ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:54.803288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001fdaa-1568-4ff7-a3cc-ed3a1a508ddb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:54.803568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001fdaa-1568-4ff7-a3cc-ed3a1a508ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:54.803836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001fdaa-1568-4ff7-a3cc-ed3a1a508ddb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:54.806520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:54.811298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001fdaa-1568-4ff7-a3cc-ed3a1a508ddb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:54.813264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001fdaa-1568-4ff7-a3cc-ed3a1a508ddb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-8001fdaa-1568-4ff7-a3cc-ed3a1a508ddb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:20:54.827031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:54.828710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:20:54.829901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 626/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:54.835030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fedba-8f25-42f7-8674-b3e0f69227d2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:54.934630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fedba-8f25-42f7-8674-b3e0f69227d2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:54.968768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec767-0d29-46b6-a6d0-ccb3fb174056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:54.969449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec767-0d29-46b6-a6d0-ccb3fb174056 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:54.969736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec767-0d29-46b6-a6d0-ccb3fb174056 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:54.970014 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec767-0d29-46b6-a6d0-ccb3fb174056 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:54.970833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ec767-0d29-46b6-a6d0-ccb3fb174056 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:54.971142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ec767-0d29-46b6-a6d0-ccb3fb174056 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:54.972626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ec767-0d29-46b6-a6d0-ccb3fb174056 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:54.990019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 614/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Jun 16 17:20:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:54.996144 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001fdaa-1568-4ff7-a3cc-ed3a1a508ddb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:55.096517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001fdaa-1568-4ff7-a3cc-ed3a1a508ddb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:55.129485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d889974-b2c7-4d47-a4e6-2076e11dac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:55.130398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d889974-b2c7-4d47-a4e6-2076e11dac1a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:55.131640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d889974-b2c7-4d47-a4e6-2076e11dac1a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:55.131640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d889974-b2c7-4d47-a4e6-2076e11dac1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:55.191087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:55.197544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d889974-b2c7-4d47-a4e6-2076e11dac1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:55.198983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d889974-b2c7-4d47-a4e6-2076e11dac1a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:55.295907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 627/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:20:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:20:55.302025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec767-0d29-46b6-a6d0-ccb3fb174056 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:55.329537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:55.399786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec767-0d29-46b6-a6d0-ccb3fb174056 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:55.433051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735932f9-1b63-49d4-82f7-e556043a6c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:55.433836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735932f9-1b63-49d4-82f7-e556043a6c31 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:55.434117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735932f9-1b63-49d4-82f7-e556043a6c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:55.434388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735932f9-1b63-49d4-82f7-e556043a6c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:55.446503 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735932f9-1b63-49d4-82f7-e556043a6c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:55.447936 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735932f9-1b63-49d4-82f7-e556043a6c31 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-735932f9-1b63-49d4-82f7-e556043a6c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:20:55.472487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:55.478529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:55.479527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:20:55.479527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:20:55.479527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:55.479527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:55.479527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 615/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:55.479822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d889974-b2c7-4d47-a4e6-2076e11dac1a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:55.575140 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:55.581738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d889974-b2c7-4d47-a4e6-2076e11dac1a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:55.613843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0937d-c06f-47c2-adbf-c840b210bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:55.614501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0937d-c06f-47c2-adbf-c840b210bef7 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:55.614777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0937d-c06f-47c2-adbf-c840b210bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:55.615046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0937d-c06f-47c2-adbf-c840b210bef7 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:55.615746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0937d-c06f-47c2-adbf-c840b210bef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:55.616048 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0937d-c06f-47c2-adbf-c840b210bef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:55.617432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0937d-c06f-47c2-adbf-c840b210bef7 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:55.628714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 628/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:55.634625 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735932f9-1b63-49d4-82f7-e556043a6c31 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:55.714718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:55.736060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735932f9-1b63-49d4-82f7-e556043a6c31 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:55.770357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427550ec-23fc-4d12-86fa-88c57fbf684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:55.771149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427550ec-23fc-4d12-86fa-88c57fbf684d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:55.771432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427550ec-23fc-4d12-86fa-88c57fbf684d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:55.771708 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427550ec-23fc-4d12-86fa-88c57fbf684d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:55.778234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427550ec-23fc-4d12-86fa-88c57fbf684d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:55.779662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427550ec-23fc-4d12-86fa-88c57fbf684d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-427550ec-23fc-4d12-86fa-88c57fbf684d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:20:55.793965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:55.794982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:55.795884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:20:55.795884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:20:55.795884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:20:55.795884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:20:55.795884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:20:55.795884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:20:55.795884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:20:55.795884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:55.795884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 616/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:55.802472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0937d-c06f-47c2-adbf-c840b210bef7 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:55.901238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0937d-c06f-47c2-adbf-c840b210bef7 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:55.934206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bfb94-5bcd-453b-be0e-e0af67d6d207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:55.934958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bfb94-5bcd-453b-be0e-e0af67d6d207 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:55.935233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bfb94-5bcd-453b-be0e-e0af67d6d207 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:55.935506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bfb94-5bcd-453b-be0e-e0af67d6d207 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:55.936310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bfb94-5bcd-453b-be0e-e0af67d6d207 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:55.939733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bfb94-5bcd-453b-be0e-e0af67d6d207 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:55.939733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bfb94-5bcd-453b-be0e-e0af67d6d207 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:55.951716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 629/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:55.958247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427550ec-23fc-4d12-86fa-88c57fbf684d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:56.056763 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427550ec-23fc-4d12-86fa-88c57fbf684d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:56.089238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec6137-f436-4fc2-872c-a1ec053754c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:56.089884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec6137-f436-4fc2-872c-a1ec053754c7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:56.090167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec6137-f436-4fc2-872c-a1ec053754c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:56.090440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec6137-f436-4fc2-872c-a1ec053754c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:56.091242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec6137-f436-4fc2-872c-a1ec053754c7 None admin] RBAC: Adding query filter params (role.id=2e0782565f884df9ba31ae571e465e25, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=a2909d4015ac45fcaf6d1fc8e488aa44) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:56.091552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec6137-f436-4fc2-872c-a1ec053754c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:56.092992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec6137-f436-4fc2-872c-a1ec053754c7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:56.099309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 617/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:20:55 2022] GET /identity/v3/role_assignments?user.id=a2909d4015ac45fcaf6d1fc8e488aa44&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=2e0782565f884df9ba31ae571e465e25 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:58.327120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d074eb-80a0-4ba2-90cf-cfd7396068a8 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:58.327693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d074eb-80a0-4ba2-90cf-cfd7396068a8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:58.327791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d074eb-80a0-4ba2-90cf-cfd7396068a8 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:58.329125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 630/1247] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:20:58.334291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56b24-ad8a-4dba-9a5b-08e0874636d4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:58.334728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56b24-ad8a-4dba-9a5b-08e0874636d4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:58.334837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56b24-ad8a-4dba-9a5b-08e0874636d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:58.340120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:58.353966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e3c56b24-ad8a-4dba-9a5b-08e0874636d4 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:20:58.355185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e3c56b24-ad8a-4dba-9a5b-08e0874636d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:20:58.423979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 618/1248] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:20:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:20:58.448713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d074eb-80a0-4ba2-90cf-cfd7396068a8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:58.466789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:58.548785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d074eb-80a0-4ba2-90cf-cfd7396068a8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:58.583298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c4ffc-19d9-4b3a-8a08-545f4c8d2044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:58.584037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c4ffc-19d9-4b3a-8a08-545f4c8d2044 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:58.584342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c4ffc-19d9-4b3a-8a08-545f4c8d2044 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:58.584682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c4ffc-19d9-4b3a-8a08-545f4c8d2044 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:58.595113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c4ffc-19d9-4b3a-8a08-545f4c8d2044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-6d2c4ffc-19d9-4b3a-8a08-545f4c8d2044 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:20:58.602596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:58.603688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:20:58.604760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 631/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:58.610544 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c56b24-ad8a-4dba-9a5b-08e0874636d4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:58.707804 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c56b24-ad8a-4dba-9a5b-08e0874636d4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:58.738083 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:58.742901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091901ef-0b23-4c01-a56c-42f4c9e1a8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:58.743564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091901ef-0b23-4c01-a56c-42f4c9e1a8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:58.743841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091901ef-0b23-4c01-a56c-42f4c9e1a8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:58.744139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091901ef-0b23-4c01-a56c-42f4c9e1a8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:58.744870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091901ef-0b23-4c01-a56c-42f4c9e1a8c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:58.745171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091901ef-0b23-4c01-a56c-42f4c9e1a8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:58.746525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091901ef-0b23-4c01-a56c-42f4c9e1a8c1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:58.754580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 619/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:20:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:58.761210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c4ffc-19d9-4b3a-8a08-545f4c8d2044 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:58.837858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:58.861918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c4ffc-19d9-4b3a-8a08-545f4c8d2044 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:58.895264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a9df6-b7d4-45fe-af68-cf87d09bfc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:58.903754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a9df6-b7d4-45fe-af68-cf87d09bfc30 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:58.903754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a9df6-b7d4-45fe-af68-cf87d09bfc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:58.903754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a9df6-b7d4-45fe-af68-cf87d09bfc30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:58.907616 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a9df6-b7d4-45fe-af68-cf87d09bfc30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:58.909073 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a9df6-b7d4-45fe-af68-cf87d09bfc30 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-ac8a9df6-b7d4-45fe-af68-cf87d09bfc30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:20:58.925641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:58.928169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:58.929198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:20:58.929198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:20:58.929198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:58.929198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:20:58.929198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 632/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:58.932824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091901ef-0b23-4c01-a56c-42f4c9e1a8c1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:59.036973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091901ef-0b23-4c01-a56c-42f4c9e1a8c1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:59.070432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295407d6-280d-4429-bd92-a1521234042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:59.071192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295407d6-280d-4429-bd92-a1521234042b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:59.071405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295407d6-280d-4429-bd92-a1521234042b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:59.071685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295407d6-280d-4429-bd92-a1521234042b None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:59.072455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295407d6-280d-4429-bd92-a1521234042b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:59.072764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295407d6-280d-4429-bd92-a1521234042b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:59.074147 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295407d6-280d-4429-bd92-a1521234042b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:59.087036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 620/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:59.092829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a9df6-b7d4-45fe-af68-cf87d09bfc30 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:59.193647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a9df6-b7d4-45fe-af68-cf87d09bfc30 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:59.220710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:59.228551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395cec6-981c-40d1-80ba-cea655260e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:59.229390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395cec6-981c-40d1-80ba-cea655260e61 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:59.229672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395cec6-981c-40d1-80ba-cea655260e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:59.229947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395cec6-981c-40d1-80ba-cea655260e61 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:59.237991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395cec6-981c-40d1-80ba-cea655260e61 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:59.239478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395cec6-981c-40d1-80ba-cea655260e61 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-9395cec6-981c-40d1-80ba-cea655260e61 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:20:59.253816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:59.255276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:20:59.256684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 633/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:59.261107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295407d6-280d-4429-bd92-a1521234042b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:59.317419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:59.361925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295407d6-280d-4429-bd92-a1521234042b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:59.396106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d37813-59e9-420b-b34a-d62e890e409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:59.396789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d37813-59e9-420b-b34a-d62e890e409a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:59.397077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d37813-59e9-420b-b34a-d62e890e409a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:59.397357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d37813-59e9-420b-b34a-d62e890e409a None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:59.398182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d37813-59e9-420b-b34a-d62e890e409a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:20:59.398497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d37813-59e9-420b-b34a-d62e890e409a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:59.400099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d37813-59e9-420b-b34a-d62e890e409a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:59.417524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 621/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Jun 16 17:20:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:20:59.424008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395cec6-981c-40d1-80ba-cea655260e61 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:59.522202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395cec6-981c-40d1-80ba-cea655260e61 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:59.555707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42990e3a-2fea-4640-a0d1-375b531b83cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:59.556391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42990e3a-2fea-4640-a0d1-375b531b83cb None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:59.556679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42990e3a-2fea-4640-a0d1-375b531b83cb None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:59.556964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42990e3a-2fea-4640-a0d1-375b531b83cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:59.613583 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:59.626025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42990e3a-2fea-4640-a0d1-375b531b83cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:59.627467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42990e3a-2fea-4640-a0d1-375b531b83cb None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:59.724175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 634/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:20:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:20:59.730183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d37813-59e9-420b-b34a-d62e890e409a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:59.832875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d37813-59e9-420b-b34a-d62e890e409a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:20:59.845467 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:20:59.866651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33230339-342a-4801-b6cc-c755163d6e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:20:59.867424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230339-342a-4801-b6cc-c755163d6e8b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:20:59.867711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230339-342a-4801-b6cc-c755163d6e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:20:59.867989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230339-342a-4801-b6cc-c755163d6e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:20:59.877867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33230339-342a-4801-b6cc-c755163d6e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:20:59.879307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33230339-342a-4801-b6cc-c755163d6e8b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-33230339-342a-4801-b6cc-c755163d6e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:20:59.897951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:20:59.899034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:20:59.900353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:20:59.900353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:20:59.900353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:20:59.900353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:20:59.900353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 622/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:20:59.907222 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42990e3a-2fea-4640-a0d1-375b531b83cb None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:20:59.991340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:00.002979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42990e3a-2fea-4640-a0d1-375b531b83cb None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:00.039177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e479f59-2b16-49c9-866f-aec031deb94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:00.039849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e479f59-2b16-49c9-866f-aec031deb94a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:00.040163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e479f59-2b16-49c9-866f-aec031deb94a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:00.040444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e479f59-2b16-49c9-866f-aec031deb94a None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:00.041297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e479f59-2b16-49c9-866f-aec031deb94a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:00.041796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e479f59-2b16-49c9-866f-aec031deb94a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:00.043963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e479f59-2b16-49c9-866f-aec031deb94a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:00.056780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 635/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:21:00.063517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33230339-342a-4801-b6cc-c755163d6e8b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:00.161849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33230339-342a-4801-b6cc-c755163d6e8b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:00.194635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e86874-c5e8-4a34-ba1a-6e63cfbe04b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:00.195421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e86874-c5e8-4a34-ba1a-6e63cfbe04b5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:00.195696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e86874-c5e8-4a34-ba1a-6e63cfbe04b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:00.195968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e86874-c5e8-4a34-ba1a-6e63cfbe04b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:00.202486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e86874-c5e8-4a34-ba1a-6e63cfbe04b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:00.204531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e86874-c5e8-4a34-ba1a-6e63cfbe04b5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-01e86874-c5e8-4a34-ba1a-6e63cfbe04b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:21:00.217680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:00.218789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:00.219671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:21:00.219671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:21:00.219671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:21:00.219671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:21:00.219671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:21:00.219671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:21:00.219671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:21:00.219671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:00.219671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 623/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:21:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:00.224882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e479f59-2b16-49c9-866f-aec031deb94a None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:00.324626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e479f59-2b16-49c9-866f-aec031deb94a None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:00.358825 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca572dd-87bd-4628-a50c-146c2e9944e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:00.359575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca572dd-87bd-4628-a50c-146c2e9944e2 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:00.359858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca572dd-87bd-4628-a50c-146c2e9944e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:00.360178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca572dd-87bd-4628-a50c-146c2e9944e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:00.360952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca572dd-87bd-4628-a50c-146c2e9944e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:00.361263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca572dd-87bd-4628-a50c-146c2e9944e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:00.362682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca572dd-87bd-4628-a50c-146c2e9944e2 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:00.375525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 636/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:21:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:00.381890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e86874-c5e8-4a34-ba1a-6e63cfbe04b5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:00.410174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:00.484692 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e86874-c5e8-4a34-ba1a-6e63cfbe04b5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:00.517893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05026ea4-a39a-4819-8945-d9095620698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:00.518543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05026ea4-a39a-4819-8945-d9095620698e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:00.518827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05026ea4-a39a-4819-8945-d9095620698e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:00.519105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05026ea4-a39a-4819-8945-d9095620698e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:00.519919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05026ea4-a39a-4819-8945-d9095620698e None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=a2909d4015ac45fcaf6d1fc8e488aa44) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:00.520263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05026ea4-a39a-4819-8945-d9095620698e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:00.521695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05026ea4-a39a-4819-8945-d9095620698e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:00.527104 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 624/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:21:00 2022] GET /identity/v3/role_assignments?user.id=a2909d4015ac45fcaf6d1fc8e488aa44&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:02.637383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945108-589f-4be3-89d0-2cf5d8e93c4f None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:02.637925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945108-589f-4be3-89d0-2cf5d8e93c4f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:02.637925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945108-589f-4be3-89d0-2cf5d8e93c4f None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:02.639286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 637/1261] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:21:02.645254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599de91-3022-4137-887b-ed985681d797 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:02.645646 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599de91-3022-4137-887b-ed985681d797 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:02.645833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599de91-3022-4137-887b-ed985681d797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:02.662559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b599de91-3022-4137-887b-ed985681d797 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:02.663748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b599de91-3022-4137-887b-ed985681d797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:02.730298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 625/1262] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:21:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:21:02.756546 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc945108-589f-4be3-89d0-2cf5d8e93c4f None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:02.767584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:02.855914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc945108-589f-4be3-89d0-2cf5d8e93c4f None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:02.890569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a2d9d-5145-4835-a45d-f7d3bdbad8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:02.891395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a2d9d-5145-4835-a45d-f7d3bdbad8bd None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:02.891676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a2d9d-5145-4835-a45d-f7d3bdbad8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:02.891949 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a2d9d-5145-4835-a45d-f7d3bdbad8bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:02.901680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a2d9d-5145-4835-a45d-f7d3bdbad8bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-c33a2d9d-5145-4835-a45d-f7d3bdbad8bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:21:02.909480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:02.910658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:21:02.911589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 638/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:21:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 17:21:02.916915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599de91-3022-4137-887b-ed985681d797 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:02.937538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:03.015408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599de91-3022-4137-887b-ed985681d797 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:03.048173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb7240-a72d-48ee-9484-f2a67f7f8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:03.048831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb7240-a72d-48ee-9484-f2a67f7f8baa None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:03.049107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb7240-a72d-48ee-9484-f2a67f7f8baa None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:03.049377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb7240-a72d-48ee-9484-f2a67f7f8baa None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:03.050101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb7240-a72d-48ee-9484-f2a67f7f8baa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:03.050404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb7240-a72d-48ee-9484-f2a67f7f8baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:03.051755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb7240-a72d-48ee-9484-f2a67f7f8baa None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:03.060551 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 626/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:21:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:03.066351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a2d9d-5145-4835-a45d-f7d3bdbad8bd None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:03.133031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:03.165427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a2d9d-5145-4835-a45d-f7d3bdbad8bd None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:03.198779 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a04af-33cb-4deb-be30-2fcf6955a113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:03.199636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a04af-33cb-4deb-be30-2fcf6955a113 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:03.199890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a04af-33cb-4deb-be30-2fcf6955a113 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:03.200195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a04af-33cb-4deb-be30-2fcf6955a113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:03.210829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a04af-33cb-4deb-be30-2fcf6955a113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:03.212291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a04af-33cb-4deb-be30-2fcf6955a113 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-2c6a04af-33cb-4deb-be30-2fcf6955a113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:21:03.229613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:03.230669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:03.231756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:21:03.231756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:21:03.231756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:21:03.231756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:21:03.231756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 639/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:03.237307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb7240-a72d-48ee-9484-f2a67f7f8baa None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:03.320860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:03.339886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb7240-a72d-48ee-9484-f2a67f7f8baa None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:03.373866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd0d81-3592-4525-9e83-4210b225a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:03.374571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd0d81-3592-4525-9e83-4210b225a879 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:03.374855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd0d81-3592-4525-9e83-4210b225a879 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:03.375125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd0d81-3592-4525-9e83-4210b225a879 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:03.375828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd0d81-3592-4525-9e83-4210b225a879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:03.376162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd0d81-3592-4525-9e83-4210b225a879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:03.377529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd0d81-3592-4525-9e83-4210b225a879 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:03.393131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 627/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:03.395459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a04af-33cb-4deb-be30-2fcf6955a113 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:03.493938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a04af-33cb-4deb-be30-2fcf6955a113 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:03.512993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:03.526874 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a2a14-728b-44af-b6be-fe14a2d9959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:03.527666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2a14-728b-44af-b6be-fe14a2d9959b None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:03.527947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2a14-728b-44af-b6be-fe14a2d9959b None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:03.528301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2a14-728b-44af-b6be-fe14a2d9959b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:03.536098 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a2a14-728b-44af-b6be-fe14a2d9959b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:03.537543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a2a14-728b-44af-b6be-fe14a2d9959b None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-e76a2a14-728b-44af-b6be-fe14a2d9959b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:21:03.551678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:03.552829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:21:03.554270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 640/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:21:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:03.558667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd0d81-3592-4525-9e83-4210b225a879 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:03.659295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd0d81-3592-4525-9e83-4210b225a879 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:03.692914 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08c55c-ec95-4dea-baff-bfaf7e661231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:03.693577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08c55c-ec95-4dea-baff-bfaf7e661231 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:03.693854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08c55c-ec95-4dea-baff-bfaf7e661231 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:03.694170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08c55c-ec95-4dea-baff-bfaf7e661231 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:03.694976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08c55c-ec95-4dea-baff-bfaf7e661231 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:03.695279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08c55c-ec95-4dea-baff-bfaf7e661231 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:03.696726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08c55c-ec95-4dea-baff-bfaf7e661231 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:03.705410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:03.713714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 628/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Jun 16 17:21:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:03.719708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a2a14-728b-44af-b6be-fe14a2d9959b None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:03.819766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a2a14-728b-44af-b6be-fe14a2d9959b None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:03.853015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86ac12-425a-4f22-857f-74768c948830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:03.853803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86ac12-425a-4f22-857f-74768c948830 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:03.854085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86ac12-425a-4f22-857f-74768c948830 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:03.854359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86ac12-425a-4f22-857f-74768c948830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:03.865321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86ac12-425a-4f22-857f-74768c948830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:03.866754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86ac12-425a-4f22-857f-74768c948830 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-4c86ac12-425a-4f22-857f-74768c948830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:21:03.883702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:03.884847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:03.886143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:21:03.886143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:21:03.886143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:21:03.886143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:21:03.886143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 641/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:03.890797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08c55c-ec95-4dea-baff-bfaf7e661231 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:03.990471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08c55c-ec95-4dea-baff-bfaf7e661231 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:04.023895 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e4eb2-a091-4b04-a339-3a35dee9d9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:04.024586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e4eb2-a091-4b04-a339-3a35dee9d9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:04.024866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e4eb2-a091-4b04-a339-3a35dee9d9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:04.025140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e4eb2-a091-4b04-a339-3a35dee9d9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:04.025839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e4eb2-a091-4b04-a339-3a35dee9d9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:04.026140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e4eb2-a091-4b04-a339-3a35dee9d9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:04.027482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e4eb2-a091-4b04-a339-3a35dee9d9e6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:04.038928 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 629/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:04.044616 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86ac12-425a-4f22-857f-74768c948830 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:04.075708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:04.148570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86ac12-425a-4f22-857f-74768c948830 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:04.183108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da787-2a23-4b61-9b3a-63f0cea4b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:04.183904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da787-2a23-4b61-9b3a-63f0cea4b70d None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:04.184227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da787-2a23-4b61-9b3a-63f0cea4b70d None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:04.184508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da787-2a23-4b61-9b3a-63f0cea4b70d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:04.191484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da787-2a23-4b61-9b3a-63f0cea4b70d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:04.192865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da787-2a23-4b61-9b3a-63f0cea4b70d None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-f82da787-2a23-4b61-9b3a-63f0cea4b70d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:21:04.208280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:04.209344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:04.210597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:21:04.210597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:21:04.210597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:21:04.210597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:21:04.210597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:21:04.210597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:21:04.210597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:21:04.210597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:21:04.210597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 642/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:04.215315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e4eb2-a091-4b04-a339-3a35dee9d9e6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:04.274884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:04.316055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e4eb2-a091-4b04-a339-3a35dee9d9e6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:04.349821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d724e-17b8-453f-b15a-fa9ded5288d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:04.350483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d724e-17b8-453f-b15a-fa9ded5288d3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:04.350769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d724e-17b8-453f-b15a-fa9ded5288d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:04.351068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d724e-17b8-453f-b15a-fa9ded5288d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:04.351843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d724e-17b8-453f-b15a-fa9ded5288d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:04.352185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d724e-17b8-453f-b15a-fa9ded5288d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:04.353619 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d724e-17b8-453f-b15a-fa9ded5288d3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:04.367085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 630/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:21:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:04.373089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da787-2a23-4b61-9b3a-63f0cea4b70d None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:04.464230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:04.472799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da787-2a23-4b61-9b3a-63f0cea4b70d None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:04.506185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4f3a6-ead2-46b8-9e05-15928cd8603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:04.507057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4f3a6-ead2-46b8-9e05-15928cd8603e None admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:04.507336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4f3a6-ead2-46b8-9e05-15928cd8603e None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:04.507609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4f3a6-ead2-46b8-9e05-15928cd8603e None admin] PATH_INFO: `/v3/projects/e31fda51efda44ff801368222163cc09/users/a2909d4015ac45fcaf6d1fc8e488aa44/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:04.509551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4f3a6-ead2-46b8-9e05-15928cd8603e None admin] RBAC: Authorizing `identity:create_grant(project_id=e31fda51efda44ff801368222163cc09, user_id=a2909d4015ac45fcaf6d1fc8e488aa44, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:04.510957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4f3a6-ead2-46b8-9e05-15928cd8603e None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:04.724580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 643/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Thu Jun 16 17:21:04 2022] PUT /identity/v3/projects/e31fda51efda44ff801368222163cc09/users/a2909d4015ac45fcaf6d1fc8e488aa44/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:21:06.847505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18108c0-1e1e-4a18-8e5e-776ad2240f48 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:06.848022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18108c0-1e1e-4a18-8e5e-776ad2240f48 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:06.848022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18108c0-1e1e-4a18-8e5e-776ad2240f48 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:06.849390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 631/1274] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:21:06.854551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e68bd8-a44b-4e33-9830-8d6be817e230 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:06.854967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e68bd8-a44b-4e33-9830-8d6be817e230 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:06.855119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e68bd8-a44b-4e33-9830-8d6be817e230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:06.872576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-43e68bd8-a44b-4e33-9830-8d6be817e230 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:06.878058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-43e68bd8-a44b-4e33-9830-8d6be817e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:06.940784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 644/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:21:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:21:06.963830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18108c0-1e1e-4a18-8e5e-776ad2240f48 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:07.065221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18108c0-1e1e-4a18-8e5e-776ad2240f48 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:07.082143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:07.098848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3c4a-fd98-4308-968f-d8fda3932917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:07.099584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3c4a-fd98-4308-968f-d8fda3932917 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:07.099867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3c4a-fd98-4308-968f-d8fda3932917 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:07.100171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3c4a-fd98-4308-968f-d8fda3932917 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:07.110822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd3c4a-fd98-4308-968f-d8fda3932917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-8fdd3c4a-fd98-4308-968f-d8fda3932917 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 17:21:07.118508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:07.119601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:07.120545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 632/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Thu Jun 16 17:21:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:07.125867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e68bd8-a44b-4e33-9830-8d6be817e230 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:07.208400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:07.226604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e68bd8-a44b-4e33-9830-8d6be817e230 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:07.260598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11be85-b220-4a03-b4ac-1c10cb6a9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:07.261262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11be85-b220-4a03-b4ac-1c10cb6a9180 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:07.261543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11be85-b220-4a03-b4ac-1c10cb6a9180 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:07.261820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11be85-b220-4a03-b4ac-1c10cb6a9180 None admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:07.262563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11be85-b220-4a03-b4ac-1c10cb6a9180 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:07.262868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11be85-b220-4a03-b4ac-1c10cb6a9180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:07.264292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11be85-b220-4a03-b4ac-1c10cb6a9180 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:07.272411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 645/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Thu Jun 16 17:21:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:07.278406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3c4a-fd98-4308-968f-d8fda3932917 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:07.379391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3c4a-fd98-4308-968f-d8fda3932917 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:07.412479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02e1b-caaf-4b41-9fbf-f1e83fe61644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:07.413273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02e1b-caaf-4b41-9fbf-f1e83fe61644 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:07.413560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02e1b-caaf-4b41-9fbf-f1e83fe61644 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:07.413842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02e1b-caaf-4b41-9fbf-f1e83fe61644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:07.425539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c02e1b-caaf-4b41-9fbf-f1e83fe61644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:07.430562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c02e1b-caaf-4b41-9fbf-f1e83fe61644 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b1c02e1b-caaf-4b41-9fbf-f1e83fe61644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:21:07.444328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:07.445384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:07.446703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:21:07.446703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:21:07.446703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:21:07.446703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:07.446703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 633/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:07.451349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11be85-b220-4a03-b4ac-1c10cb6a9180 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:07.550014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11be85-b220-4a03-b4ac-1c10cb6a9180 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:07.583582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17997d-c925-4a58-b09d-9030b67bfa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:07.584285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17997d-c925-4a58-b09d-9030b67bfa60 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:07.590119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17997d-c925-4a58-b09d-9030b67bfa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:07.590119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17997d-c925-4a58-b09d-9030b67bfa60 None admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:07.590119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17997d-c925-4a58-b09d-9030b67bfa60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:07.590119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17997d-c925-4a58-b09d-9030b67bfa60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:07.590119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17997d-c925-4a58-b09d-9030b67bfa60 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:07.599498 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 646/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:07.605179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02e1b-caaf-4b41-9fbf-f1e83fe61644 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:07.636692 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:07.705741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02e1b-caaf-4b41-9fbf-f1e83fe61644 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:07.739495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d192375-e234-431f-9ef6-96f7d3a78f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:07.740378 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d192375-e234-431f-9ef6-96f7d3a78f8e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:07.740668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d192375-e234-431f-9ef6-96f7d3a78f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:07.740949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d192375-e234-431f-9ef6-96f7d3a78f8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:07.749184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d192375-e234-431f-9ef6-96f7d3a78f8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:07.750612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d192375-e234-431f-9ef6-96f7d3a78f8e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7d192375-e234-431f-9ef6-96f7d3a78f8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 17:21:07.765151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:07.766064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:07.766995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 634/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:21:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:07.772377 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17997d-c925-4a58-b09d-9030b67bfa60 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:07.776126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:07.871320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17997d-c925-4a58-b09d-9030b67bfa60 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:07.907633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366c645-94a6-4258-83b8-ee1fcda4b962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:07.908259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c645-94a6-4258-83b8-ee1fcda4b962 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:07.908548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c645-94a6-4258-83b8-ee1fcda4b962 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:07.908818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c645-94a6-4258-83b8-ee1fcda4b962 None admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:07.909628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366c645-94a6-4258-83b8-ee1fcda4b962 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:07.909933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366c645-94a6-4258-83b8-ee1fcda4b962 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:07.911343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366c645-94a6-4258-83b8-ee1fcda4b962 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:07.928553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 647/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Thu Jun 16 17:21:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:07.934299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d192375-e234-431f-9ef6-96f7d3a78f8e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:08.027355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:08.037972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d192375-e234-431f-9ef6-96f7d3a78f8e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:08.071028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f803ca-aa1d-4d78-832f-cb2834d3a832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:08.071679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f803ca-aa1d-4d78-832f-cb2834d3a832 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:08.071971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f803ca-aa1d-4d78-832f-cb2834d3a832 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:08.072278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f803ca-aa1d-4d78-832f-cb2834d3a832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:08.138348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f803ca-aa1d-4d78-832f-cb2834d3a832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:08.140332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f803ca-aa1d-4d78-832f-cb2834d3a832 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:08.226817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:08.236947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 635/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Thu Jun 16 17:21:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 17:21:08.242798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366c645-94a6-4258-83b8-ee1fcda4b962 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:08.305145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:08.343446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366c645-94a6-4258-83b8-ee1fcda4b962 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:08.376052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee86f-57ba-42ce-b059-d6620a8f7056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:08.376867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee86f-57ba-42ce-b059-d6620a8f7056 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:08.377150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee86f-57ba-42ce-b059-d6620a8f7056 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:08.377425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee86f-57ba-42ce-b059-d6620a8f7056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:08.388298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacee86f-57ba-42ce-b059-d6620a8f7056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:08.390483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacee86f-57ba-42ce-b059-d6620a8f7056 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-aacee86f-57ba-42ce-b059-d6620a8f7056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 17:21:08.407572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:08.408731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:08.409982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 17:21:08.409982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 17:21:08.409982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 17:21:08.409982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:21:08.409982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 648/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:08.414432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f803ca-aa1d-4d78-832f-cb2834d3a832 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:08.514320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f803ca-aa1d-4d78-832f-cb2834d3a832 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:08.550143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cf552-10a7-4e3a-a2e7-ace698833885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:08.550837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cf552-10a7-4e3a-a2e7-ace698833885 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:08.551125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cf552-10a7-4e3a-a2e7-ace698833885 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:08.551425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cf552-10a7-4e3a-a2e7-ace698833885 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:08.552194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cf552-10a7-4e3a-a2e7-ace698833885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:08.552507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cf552-10a7-4e3a-a2e7-ace698833885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:08.553913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cf552-10a7-4e3a-a2e7-ace698833885 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:08.566012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 636/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Thu Jun 16 17:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:08.571623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee86f-57ba-42ce-b059-d6620a8f7056 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:08.674693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee86f-57ba-42ce-b059-d6620a8f7056 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:08.688898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:08.707807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1848ec4-ba15-45c0-b082-f453aeebc917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:08.708608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1848ec4-ba15-45c0-b082-f453aeebc917 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:08.708891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1848ec4-ba15-45c0-b082-f453aeebc917 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:08.709165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1848ec4-ba15-45c0-b082-f453aeebc917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:08.715505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1848ec4-ba15-45c0-b082-f453aeebc917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:08.716967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1848ec4-ba15-45c0-b082-f453aeebc917 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application [None req-e1848ec4-ba15-45c0-b082-f453aeebc917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 17:21:08.730549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:08.731610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:08.732780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 17:21:08.732780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 17:21:08.732780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 17:21:08.732780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 17:21:08.732780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 17:21:08.732780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 17:21:08.732780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 17:21:08.732780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: ERROR keystone.server.flask.application Jun 16 17:21:08.732780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 649/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Thu Jun 16 17:21:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:08.738282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cf552-10a7-4e3a-a2e7-ace698833885 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:08.789412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:08.841922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cf552-10a7-4e3a-a2e7-ace698833885 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:08.877903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7e84c-9f1f-44e4-be54-df2b62b151b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:08.878567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e84c-9f1f-44e4-be54-df2b62b151b8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:08.878900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e84c-9f1f-44e4-be54-df2b62b151b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:08.879184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e84c-9f1f-44e4-be54-df2b62b151b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:08.880266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7e84c-9f1f-44e4-be54-df2b62b151b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:08.880575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7e84c-9f1f-44e4-be54-df2b62b151b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:08.881996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7e84c-9f1f-44e4-be54-df2b62b151b8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:08.894631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 637/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Thu Jun 16 17:21:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:08.901006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1848ec4-ba15-45c0-b082-f453aeebc917 None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:09.005318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1848ec4-ba15-45c0-b082-f453aeebc917 None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:09.039605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d57ffb-3edf-42a9-8a08-0195df30ceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:09.040292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d57ffb-3edf-42a9-8a08-0195df30ceca None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:09.040582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d57ffb-3edf-42a9-8a08-0195df30ceca None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:09.040862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d57ffb-3edf-42a9-8a08-0195df30ceca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:09.041680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d57ffb-3edf-42a9-8a08-0195df30ceca None admin] RBAC: Adding query filter params (role.id=5e1acfd8acd8439fb83cf43ffc4d1984, scope.project.id=e31fda51efda44ff801368222163cc09, user.id=a2909d4015ac45fcaf6d1fc8e488aa44) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:09.041994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d57ffb-3edf-42a9-8a08-0195df30ceca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:09.043414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d57ffb-3edf-42a9-8a08-0195df30ceca None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:09.049873 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 650/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Thu Jun 16 17:21:08 2022] GET /identity/v3/role_assignments?user.id=a2909d4015ac45fcaf6d1fc8e488aa44&scope.project.id=e31fda51efda44ff801368222163cc09&role.id=5e1acfd8acd8439fb83cf43ffc4d1984 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:11.223578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac9c4-7f3a-4ba2-93ce-6f01b4bd75f2 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:11.224151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac9c4-7f3a-4ba2-93ce-6f01b4bd75f2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:11.224151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac9c4-7f3a-4ba2-93ce-6f01b4bd75f2 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:11.225646 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 638/1288] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:21:11.230787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40da198-13b5-426b-84a4-a1f2e0182a1a None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:11.231188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40da198-13b5-426b-84a4-a1f2e0182a1a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:11.231343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40da198-13b5-426b-84a4-a1f2e0182a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:11.248669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-e40da198-13b5-426b-84a4-a1f2e0182a1a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:11.250531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e40da198-13b5-426b-84a4-a1f2e0182a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:11.279716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:11.316228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 651/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:21:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:21:11.338616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac9c4-7f3a-4ba2-93ce-6f01b4bd75f2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:11.439611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac9c4-7f3a-4ba2-93ce-6f01b4bd75f2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:11.450060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:11.473234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87ad42-cb2c-4ade-a9c1-bca78934ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:11.474086 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87ad42-cb2c-4ade-a9c1-bca78934ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:11.474313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87ad42-cb2c-4ade-a9c1-bca78934ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:11.474586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87ad42-cb2c-4ade-a9c1-bca78934ebc7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:11.475222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87ad42-cb2c-4ade-a9c1-bca78934ebc7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:11.476604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87ad42-cb2c-4ade-a9c1-bca78934ebc7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7e87ad42-cb2c-4ade-a9c1-bca78934ebc7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:11.489565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:11.490824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:11.492008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 639/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Jun 16 17:21:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:11.496737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40da198-13b5-426b-84a4-a1f2e0182a1a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:11.594339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40da198-13b5-426b-84a4-a1f2e0182a1a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:11.627543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae93914-3d0f-4da2-a9b1-a572e3b827cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:11.628239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae93914-3d0f-4da2-a9b1-a572e3b827cf None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:11.628519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae93914-3d0f-4da2-a9b1-a572e3b827cf None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:11.628788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae93914-3d0f-4da2-a9b1-a572e3b827cf None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:11.629735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae93914-3d0f-4da2-a9b1-a572e3b827cf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:11.630035 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae93914-3d0f-4da2-a9b1-a572e3b827cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:11.631383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae93914-3d0f-4da2-a9b1-a572e3b827cf None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:11.636084 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 652/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Thu Jun 16 17:21:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:11.642554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87ad42-cb2c-4ade-a9c1-bca78934ebc7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:11.741392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87ad42-cb2c-4ade-a9c1-bca78934ebc7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:11.775925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf4c5-a3b8-4ab6-a16c-3bbdd1b12543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:11.776630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf4c5-a3b8-4ab6-a16c-3bbdd1b12543 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:11.776918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf4c5-a3b8-4ab6-a16c-3bbdd1b12543 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:11.777199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf4c5-a3b8-4ab6-a16c-3bbdd1b12543 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:11.777905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf4c5-a3b8-4ab6-a16c-3bbdd1b12543 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:11.778216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf4c5-a3b8-4ab6-a16c-3bbdd1b12543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:11.779581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf4c5-a3b8-4ab6-a16c-3bbdd1b12543 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:11.784859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 640/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Thu Jun 16 17:21:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:13.906532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392249f8-8b6a-45dd-9e3f-90f5b3a48e2c None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:13.907065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392249f8-8b6a-45dd-9e3f-90f5b3a48e2c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:13.907065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392249f8-8b6a-45dd-9e3f-90f5b3a48e2c None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:13.908402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 653/1293] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:21:13.913444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6b077-63a9-40c0-92d4-36d55c64dd88 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:13.913879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6b077-63a9-40c0-92d4-36d55c64dd88 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:13.914032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6b077-63a9-40c0-92d4-36d55c64dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:13.931584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-51d6b077-63a9-40c0-92d4-36d55c64dd88 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:13.932812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-51d6b077-63a9-40c0-92d4-36d55c64dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:13.963035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:14.001133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 641/1294] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:21:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:21:14.023945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392249f8-8b6a-45dd-9e3f-90f5b3a48e2c None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:14.055189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:14.122840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392249f8-8b6a-45dd-9e3f-90f5b3a48e2c None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:14.156397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a35e56-81d7-4397-af83-368d69658dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:14.157103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a35e56-81d7-4397-af83-368d69658dad None admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:14.157342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a35e56-81d7-4397-af83-368d69658dad None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:14.157619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a35e56-81d7-4397-af83-368d69658dad None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:14.158338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a35e56-81d7-4397-af83-368d69658dad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:14.159697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a35e56-81d7-4397-af83-368d69658dad None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:14.312791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 654/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Thu Jun 16 17:21:14 2022] POST /identity/v3/services => generated 246 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:21:16.515826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf84f1-ceb2-4b48-a437-8ebe23733fb2 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:16.516391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf84f1-ceb2-4b48-a437-8ebe23733fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:16.516391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf84f1-ceb2-4b48-a437-8ebe23733fb2 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:16.517806 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 642/1296] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:21:16.523177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83013bc-1055-4275-a09b-3e47691de1cf None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:16.523610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83013bc-1055-4275-a09b-3e47691de1cf None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:16.523723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83013bc-1055-4275-a09b-3e47691de1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:16.541838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-c83013bc-1055-4275-a09b-3e47691de1cf None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:16.543022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c83013bc-1055-4275-a09b-3e47691de1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:16.616212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 655/1297] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:21:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:21:16.639313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf84f1-ceb2-4b48-a437-8ebe23733fb2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:16.741237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf84f1-ceb2-4b48-a437-8ebe23733fb2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:16.776834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b263c7-5bf7-4ee5-9fda-7eb97de3f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:16.777564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b263c7-5bf7-4ee5-9fda-7eb97de3f43d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:16.777848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b263c7-5bf7-4ee5-9fda-7eb97de3f43d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:16.778124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b263c7-5bf7-4ee5-9fda-7eb97de3f43d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:16.778765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b263c7-5bf7-4ee5-9fda-7eb97de3f43d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:16.780843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b263c7-5bf7-4ee5-9fda-7eb97de3f43d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d7b263c7-5bf7-4ee5-9fda-7eb97de3f43d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:16.792767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:16.793963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:16.794985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 643/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Jun 16 17:21:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:16.800691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83013bc-1055-4275-a09b-3e47691de1cf None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:16.818827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:16.897407 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83013bc-1055-4275-a09b-3e47691de1cf None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:16.931094 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b67f2b-0941-44ed-bf16-b3a4d66f46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:16.931746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b67f2b-0941-44ed-bf16-b3a4d66f46fe None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:16.932042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b67f2b-0941-44ed-bf16-b3a4d66f46fe None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:16.932332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b67f2b-0941-44ed-bf16-b3a4d66f46fe None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:16.933030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b67f2b-0941-44ed-bf16-b3a4d66f46fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:16.933335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b67f2b-0941-44ed-bf16-b3a4d66f46fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:16.934690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b67f2b-0941-44ed-bf16-b3a4d66f46fe None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:16.939922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 656/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Thu Jun 16 17:21:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:16.946045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b263c7-5bf7-4ee5-9fda-7eb97de3f43d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:16.978106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:17.047890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b263c7-5bf7-4ee5-9fda-7eb97de3f43d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:17.082076 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60c4e3-71e9-4dc3-8728-06d4c38d8a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:17.082739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60c4e3-71e9-4dc3-8728-06d4c38d8a13 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:17.083017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60c4e3-71e9-4dc3-8728-06d4c38d8a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:17.083291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60c4e3-71e9-4dc3-8728-06d4c38d8a13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:17.084066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60c4e3-71e9-4dc3-8728-06d4c38d8a13 None admin] RBAC: Adding query filter params (interface=public, service_id=97dc1af040cb429eb11f8ec15f884232, region_id=RegionOne) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:17.084403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60c4e3-71e9-4dc3-8728-06d4c38d8a13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:17.085760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60c4e3-71e9-4dc3-8728-06d4c38d8a13 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:17.090602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 644/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Thu Jun 16 17:21:16 2022] GET /identity/v3/endpoints?service_id=97dc1af040cb429eb11f8ec15f884232&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:17.097653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b67f2b-0941-44ed-bf16-b3a4d66f46fe None admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:17.177334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:17.194566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b67f2b-0941-44ed-bf16-b3a4d66f46fe None admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:17.228097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1687cb-461e-4cd5-b68e-fe6f0182f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:17.228774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1687cb-461e-4cd5-b68e-fe6f0182f88a None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:17.229058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1687cb-461e-4cd5-b68e-fe6f0182f88a None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:17.229332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1687cb-461e-4cd5-b68e-fe6f0182f88a None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:17.229998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1687cb-461e-4cd5-b68e-fe6f0182f88a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:17.231362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1687cb-461e-4cd5-b68e-fe6f0182f88a None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:17.238286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 657/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Thu Jun 16 17:21:17 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:21:19.357296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381b31b-dece-4a54-9ba1-587293468fdb None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:19.358371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381b31b-dece-4a54-9ba1-587293468fdb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:19.358371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381b31b-dece-4a54-9ba1-587293468fdb None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:19.359739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 645/1302] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:21:19.364885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7de4d-565a-47a0-a5f6-de0e752e18e8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:19.365289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7de4d-565a-47a0-a5f6-de0e752e18e8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:19.365430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7de4d-565a-47a0-a5f6-de0e752e18e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:19.382461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-57b7de4d-565a-47a0-a5f6-de0e752e18e8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:21:19.383632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-57b7de4d-565a-47a0-a5f6-de0e752e18e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:21:19.449069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 658/1303] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:21:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 17:21:19.475476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381b31b-dece-4a54-9ba1-587293468fdb None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:19.576839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:19.583680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381b31b-dece-4a54-9ba1-587293468fdb None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:19.619364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c38c0-82cf-4c70-8a5d-406142fcd498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:19.620118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c38c0-82cf-4c70-8a5d-406142fcd498 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:19.620406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c38c0-82cf-4c70-8a5d-406142fcd498 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:19.620687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c38c0-82cf-4c70-8a5d-406142fcd498 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:19.621330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c38c0-82cf-4c70-8a5d-406142fcd498 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:19.622688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c38c0-82cf-4c70-8a5d-406142fcd498 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-1a1c38c0-82cf-4c70-8a5d-406142fcd498 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 17:21:19.634748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 17:21:19.636012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 16 17:21:19.636967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 646/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Thu Jun 16 17:21:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 17:21:19.642190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7de4d-565a-47a0-a5f6-de0e752e18e8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:19.718235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:19.741105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7de4d-565a-47a0-a5f6-de0e752e18e8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:19.773191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b9e5-0ed1-4a48-aeec-6eaff7ae2725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:19.773845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b9e5-0ed1-4a48-aeec-6eaff7ae2725 None admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:19.774129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b9e5-0ed1-4a48-aeec-6eaff7ae2725 None admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:19.774403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b9e5-0ed1-4a48-aeec-6eaff7ae2725 None admin] PATH_INFO: `/v3/services` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:19.775089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b9e5-0ed1-4a48-aeec-6eaff7ae2725 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:21:19.775393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b9e5-0ed1-4a48-aeec-6eaff7ae2725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:19.776777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b9e5-0ed1-4a48-aeec-6eaff7ae2725 None admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:19.782483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 659/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Thu Jun 16 17:21:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:21:19.788342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c38c0-82cf-4c70-8a5d-406142fcd498 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:21:19.887312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c38c0-82cf-4c70-8a5d-406142fcd498 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:21:19.921339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8849aac-ec0b-4c87-9f5c-7c306d63592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:21:19.921989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8849aac-ec0b-4c87-9f5c-7c306d63592a None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:21:19.922270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8849aac-ec0b-4c87-9f5c-7c306d63592a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:21:19.922579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8849aac-ec0b-4c87-9f5c-7c306d63592a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:21:19.923280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8849aac-ec0b-4c87-9f5c-7c306d63592a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:21:19.924675 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8849aac-ec0b-4c87-9f5c-7c306d63592a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:21:20.060583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 647/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Thu Jun 16 17:21:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:21:29.838128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=30 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:21:30.055862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:15.789579 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f1cfd-8d07-41ee-929a-aa99f8f91ad7 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:15.790737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f1cfd-8d07-41ee-929a-aa99f8f91ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:15.791254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f1cfd-8d07-41ee-929a-aa99f8f91ad7 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:15.798830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d67a7-132f-4692-a875-fd19896a72af None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:15.800245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d67a7-132f-4692-a875-fd19896a72af None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:15.800756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d67a7-132f-4692-a875-fd19896a72af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:15.803382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 660/1307] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:15 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:15.926414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-538d67a7-132f-4692-a875-fd19896a72af None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:15.928299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-538d67a7-132f-4692-a875-fd19896a72af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:16.106869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 648/1308] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:16.143650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d6b5-9a88-466e-9e1c-6ab186395566 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:16.144676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d6b5-9a88-466e-9e1c-6ab186395566 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:16.145339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d6b5-9a88-466e-9e1c-6ab186395566 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:16.147494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 661/1309] 10.222.0.77 () {54 vars in 964 bytes} [Thu Jun 16 17:30:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:16.154483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d571063-2875-4282-9ff5-b2a8b51d8fdb None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:16.155124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d571063-2875-4282-9ff5-b2a8b51d8fdb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:16.155686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d571063-2875-4282-9ff5-b2a8b51d8fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:16.268233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2d571063-2875-4282-9ff5-b2a8b51d8fdb None None] MFA Rules not processed for user `19ce01cdbd8d4ac9bb126a6814f2d13b`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:16.270075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2d571063-2875-4282-9ff5-b2a8b51d8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:16.304452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:16.379125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d6b5-9a88-466e-9e1c-6ab186395566 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:16.381129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-dcc4d6b5-9a88-466e-9e1c-6ab186395566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:16.385387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 649/1310] 10.222.0.77 () {58 vars in 1061 bytes} [Thu Jun 16 17:30:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:30:16.514151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d6b5-9a88-466e-9e1c-6ab186395566 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:16.600838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121fa72-083e-4c0f-8ea8-4b22bdcff8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:16.601566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121fa72-083e-4c0f-8ea8-4b22bdcff8ed service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:16.601852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121fa72-083e-4c0f-8ea8-4b22bdcff8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:16.602132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121fa72-083e-4c0f-8ea8-4b22bdcff8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:16.604240 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c121fa72-083e-4c0f-8ea8-4b22bdcff8ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:16.670917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:16.746442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121fa72-083e-4c0f-8ea8-4b22bdcff8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:16.748847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121fa72-083e-4c0f-8ea8-4b22bdcff8ed service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:16.774020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 662/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:30:19.264364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938502-44ad-4ea5-8d84-1f0e3c9ac0c1 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:19.265383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938502-44ad-4ea5-8d84-1f0e3c9ac0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:19.265661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938502-44ad-4ea5-8d84-1f0e3c9ac0c1 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:19.269285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 650/1312] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:19.274731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f6927-7987-484a-a287-6aeb818d8277 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:19.275187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f6927-7987-484a-a287-6aeb818d8277 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:19.275301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f6927-7987-484a-a287-6aeb818d8277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:19.349866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ce6f6927-7987-484a-a287-6aeb818d8277 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:19.351222 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ce6f6927-7987-484a-a287-6aeb818d8277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:19.462948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 663/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:19.503245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938502-44ad-4ea5-8d84-1f0e3c9ac0c1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:19.504833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-79938502-44ad-4ea5-8d84-1f0e3c9ac0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:19.625834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938502-44ad-4ea5-8d84-1f0e3c9ac0c1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:19.699364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:19.701907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0243f60-8c49-4d5f-89dd-14ddebd23001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:19.702560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243f60-8c49-4d5f-89dd-14ddebd23001 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:19.702846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243f60-8c49-4d5f-89dd-14ddebd23001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:19.703126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243f60-8c49-4d5f-89dd-14ddebd23001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:19.705719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f0243f60-8c49-4d5f-89dd-14ddebd23001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:19.822091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0243f60-8c49-4d5f-89dd-14ddebd23001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:19.823531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0243f60-8c49-4d5f-89dd-14ddebd23001 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:19.844466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 651/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:22.552458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9da2a-310e-40f4-997f-c5db42905c93 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:22.552987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9da2a-310e-40f4-997f-c5db42905c93 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:22.552987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9da2a-310e-40f4-997f-c5db42905c93 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:22.554445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 664/1315] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:22.559776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d296-c5dd-4576-9adc-41b0810e3351 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:22.560195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d296-c5dd-4576-9adc-41b0810e3351 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:22.560372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d296-c5dd-4576-9adc-41b0810e3351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:22.628051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ed40d296-c5dd-4576-9adc-41b0810e3351 None None] MFA Rules not processed for user `11c252d8dc954906bdb78f1fc6b107f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:22.629316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ed40d296-c5dd-4576-9adc-41b0810e3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:22.682335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:22.741522 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 652/1316] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:22.781266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9da2a-310e-40f4-997f-c5db42905c93 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:22.782786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-67c9da2a-310e-40f4-997f-c5db42905c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:22.793566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:22.890495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9da2a-310e-40f4-997f-c5db42905c93 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:22.964526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526008d2-dcae-424c-af16-0e4fcbde111a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:22.965168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526008d2-dcae-424c-af16-0e4fcbde111a service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:22.965448 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526008d2-dcae-424c-af16-0e4fcbde111a service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:22.965963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526008d2-dcae-424c-af16-0e4fcbde111a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:22.967578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-526008d2-dcae-424c-af16-0e4fcbde111a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:23.032576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:23.079898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526008d2-dcae-424c-af16-0e4fcbde111a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:23.081731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526008d2-dcae-424c-af16-0e4fcbde111a service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:23.099964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 665/1317] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:26.365584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33862a-fc6d-4e12-a57c-53d9b00af171 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:26.366132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33862a-fc6d-4e12-a57c-53d9b00af171 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:26.366257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33862a-fc6d-4e12-a57c-53d9b00af171 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:26.368242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 653/1318] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:26.373743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165d0f-da35-4f5b-8503-1665ea91c6a3 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:26.374226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165d0f-da35-4f5b-8503-1665ea91c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:26.375170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165d0f-da35-4f5b-8503-1665ea91c6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:26.447923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-40165d0f-da35-4f5b-8503-1665ea91c6a3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:26.449294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-40165d0f-da35-4f5b-8503-1665ea91c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:26.559139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 666/1319] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:30:26.614984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5063bb-e3dd-4082-ba64-4fe3e1a65b3f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:26.615268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5063bb-e3dd-4082-ba64-4fe3e1a65b3f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:26.615552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5063bb-e3dd-4082-ba64-4fe3e1a65b3f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:26.617049 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 654/1320] 10.222.0.77 () {54 vars in 964 bytes} [Thu Jun 16 17:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:26.623501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bcee0-ed16-48e0-8d35-668647309a8c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:26.623721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bcee0-ed16-48e0-8d35-668647309a8c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:26.623997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bcee0-ed16-48e0-8d35-668647309a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:26.647316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:26.717362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-395bcee0-ed16-48e0-8d35-668647309a8c None None] MFA Rules not processed for user `19ce01cdbd8d4ac9bb126a6814f2d13b`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:26.718825 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-395bcee0-ed16-48e0-8d35-668647309a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:26.836449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 667/1321] 10.222.0.77 () {58 vars in 1061 bytes} [Thu Jun 16 17:30:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:30:26.846633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5063bb-e3dd-4082-ba64-4fe3e1a65b3f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:26.848853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5e5063bb-e3dd-4082-ba64-4fe3e1a65b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:26.960295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5063bb-e3dd-4082-ba64-4fe3e1a65b3f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:27.052471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35639771-000b-4da0-9349-2d2ed1667847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:27.053122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35639771-000b-4da0-9349-2d2ed1667847 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:27.053363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35639771-000b-4da0-9349-2d2ed1667847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:27.053638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35639771-000b-4da0-9349-2d2ed1667847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:27.055338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-35639771-000b-4da0-9349-2d2ed1667847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:27.064235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:27.190074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35639771-000b-4da0-9349-2d2ed1667847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:27.191758 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35639771-000b-4da0-9349-2d2ed1667847 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:27.219549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 655/1322] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:31.338277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71318c92-959b-42b8-b30b-b06d7b81898d None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:31.338811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71318c92-959b-42b8-b30b-b06d7b81898d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:31.338811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71318c92-959b-42b8-b30b-b06d7b81898d None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:31.340375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 668/1323] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:31.345848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f080-7a0e-4ca5-9e2e-b91885f16838 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:31.346312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f080-7a0e-4ca5-9e2e-b91885f16838 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:31.346393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f080-7a0e-4ca5-9e2e-b91885f16838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:31.431010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6633f080-7a0e-4ca5-9e2e-b91885f16838 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:31.432681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6633f080-7a0e-4ca5-9e2e-b91885f16838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:31.512579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:31.580238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 656/1324] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:31.616661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71318c92-959b-42b8-b30b-b06d7b81898d None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:31.618319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-71318c92-959b-42b8-b30b-b06d7b81898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:31.754643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71318c92-959b-42b8-b30b-b06d7b81898d None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:31.771108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:31.842219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d2921-bb9a-4fc4-ae8e-354a80de8d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:31.842964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2921-bb9a-4fc4-ae8e-354a80de8d61 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:31.843164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2921-bb9a-4fc4-ae8e-354a80de8d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:31.843553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2921-bb9a-4fc4-ae8e-354a80de8d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:31.846454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d29d2921-bb9a-4fc4-ae8e-354a80de8d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:31.982712 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d2921-bb9a-4fc4-ae8e-354a80de8d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:31.985438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d2921-bb9a-4fc4-ae8e-354a80de8d61 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:32.007615 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 669/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:34.311742 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f818b-c3f6-403c-afa8-8750618e706f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:34.313536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f818b-c3f6-403c-afa8-8750618e706f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:34.313536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f818b-c3f6-403c-afa8-8750618e706f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:34.314530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 657/1326] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:34.321350 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67cee8-43ac-4600-8c54-e27fed687451 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:34.321866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67cee8-43ac-4600-8c54-e27fed687451 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:34.322184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67cee8-43ac-4600-8c54-e27fed687451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:34.387437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:34.400376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-7e67cee8-43ac-4600-8c54-e27fed687451 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:34.401663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7e67cee8-43ac-4600-8c54-e27fed687451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:34.531713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 670/1327] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:30:34.574492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f818b-c3f6-403c-afa8-8750618e706f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:34.576711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b15f818b-c3f6-403c-afa8-8750618e706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:34.699983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f818b-c3f6-403c-afa8-8750618e706f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:34.787294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2159f6-5579-4a7e-b506-649078be4a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:34.787944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2159f6-5579-4a7e-b506-649078be4a59 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:34.791188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2159f6-5579-4a7e-b506-649078be4a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:34.791188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2159f6-5579-4a7e-b506-649078be4a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:34.791188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0c2159f6-5579-4a7e-b506-649078be4a59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:34.807753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:34.959925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2159f6-5579-4a7e-b506-649078be4a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:34.962155 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2159f6-5579-4a7e-b506-649078be4a59 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:34.985901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 658/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:37.247852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbc474-44ab-452a-a049-c9cc8d2e3ef4 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:37.248490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbc474-44ab-452a-a049-c9cc8d2e3ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:37.248490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbc474-44ab-452a-a049-c9cc8d2e3ef4 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:37.249950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 671/1329] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:37.255588 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39713077-8272-41fd-8d47-cc06b3e13a18 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:37.256120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39713077-8272-41fd-8d47-cc06b3e13a18 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:37.256231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39713077-8272-41fd-8d47-cc06b3e13a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:37.348615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-39713077-8272-41fd-8d47-cc06b3e13a18 None None] MFA Rules not processed for user `11c252d8dc954906bdb78f1fc6b107f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:37.349873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-39713077-8272-41fd-8d47-cc06b3e13a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:37.444648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:37.492919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 659/1330] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:37.533989 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbc474-44ab-452a-a049-c9cc8d2e3ef4 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:37.535691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-10cbc474-44ab-452a-a049-c9cc8d2e3ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:37.664911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbc474-44ab-452a-a049-c9cc8d2e3ef4 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:37.694960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:37.772542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7899a-b8c3-4b91-8eae-a7ab3c5115d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:37.773198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7899a-b8c3-4b91-8eae-a7ab3c5115d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:37.773481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7899a-b8c3-4b91-8eae-a7ab3c5115d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:37.773754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7899a-b8c3-4b91-8eae-a7ab3c5115d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:37.775487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8cb7899a-b8c3-4b91-8eae-a7ab3c5115d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:37.922765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7899a-b8c3-4b91-8eae-a7ab3c5115d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:37.924563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7899a-b8c3-4b91-8eae-a7ab3c5115d2 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:37.947908 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 672/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:40.957213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96587962-807b-4318-a1e5-4cbbda07ead1 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:40.957795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96587962-807b-4318-a1e5-4cbbda07ead1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:40.957991 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96587962-807b-4318-a1e5-4cbbda07ead1 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:40.959266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 660/1332] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:30:40.964824 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e225c-d39f-47f5-b0a2-fcf917231586 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:40.965221 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e225c-d39f-47f5-b0a2-fcf917231586 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:40.965381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e225c-d39f-47f5-b0a2-fcf917231586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:41.028530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:41.031933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-220e225c-d39f-47f5-b0a2-fcf917231586 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:41.033183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-220e225c-d39f-47f5-b0a2-fcf917231586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:41.142881 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 673/1333] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:41.180044 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96587962-807b-4318-a1e5-4cbbda07ead1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:41.181780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-96587962-807b-4318-a1e5-4cbbda07ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:41.292566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96587962-807b-4318-a1e5-4cbbda07ead1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:41.373924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d33ce-7fbd-4bc4-88f5-ce335f6b7292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:41.375100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d33ce-7fbd-4bc4-88f5-ce335f6b7292 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:41.375386 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d33ce-7fbd-4bc4-88f5-ce335f6b7292 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:41.375758 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d33ce-7fbd-4bc4-88f5-ce335f6b7292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:41.377484 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ec9d33ce-7fbd-4bc4-88f5-ce335f6b7292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:41.407040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:41.494957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d33ce-7fbd-4bc4-88f5-ce335f6b7292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:41.496559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d33ce-7fbd-4bc4-88f5-ce335f6b7292 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:41.517033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 661/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:43.767310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe787-805f-4150-9e61-041a3e55f4b8 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:43.768041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe787-805f-4150-9e61-041a3e55f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:43.768041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe787-805f-4150-9e61-041a3e55f4b8 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:43.769265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 674/1335] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:43.774740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6cd1a-53c5-4a78-b2ff-4b8a6027f31a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:43.775142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6cd1a-53c5-4a78-b2ff-4b8a6027f31a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:43.775342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6cd1a-53c5-4a78-b2ff-4b8a6027f31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:43.843955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6cf6cd1a-53c5-4a78-b2ff-4b8a6027f31a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:43.845150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6cf6cd1a-53c5-4a78-b2ff-4b8a6027f31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:43.921465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:43.947040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 662/1336] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:43.988093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe787-805f-4150-9e61-041a3e55f4b8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:43.989755 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-740fe787-805f-4150-9e61-041a3e55f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:44.099754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe787-805f-4150-9e61-041a3e55f4b8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:44.132613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:44.181841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3dfae-b430-42a2-ae3b-fc54edc059e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:44.182549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3dfae-b430-42a2-ae3b-fc54edc059e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:44.182887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3dfae-b430-42a2-ae3b-fc54edc059e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:44.183210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3dfae-b430-42a2-ae3b-fc54edc059e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:44.185001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-53b3dfae-b430-42a2-ae3b-fc54edc059e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:44.305472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3dfae-b430-42a2-ae3b-fc54edc059e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:44.306923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3dfae-b430-42a2-ae3b-fc54edc059e2 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:44.325869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 675/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:47.175005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87135-49d3-4c12-89c4-831cb32630ff None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:47.175569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87135-49d3-4c12-89c4-831cb32630ff None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:47.175569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87135-49d3-4c12-89c4-831cb32630ff None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:47.176934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 663/1338] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:47.182084 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e72bb4-2de8-4faa-bdb6-8ddb795b1fc8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:47.182547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e72bb4-2de8-4faa-bdb6-8ddb795b1fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:47.182642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e72bb4-2de8-4faa-bdb6-8ddb795b1fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:47.255548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-09e72bb4-2de8-4faa-bdb6-8ddb795b1fc8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:47.256771 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-09e72bb4-2de8-4faa-bdb6-8ddb795b1fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:47.265465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:30:47.365493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 676/1339] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:47.401217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87135-49d3-4c12-89c4-831cb32630ff None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:47.403331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6af87135-49d3-4c12-89c4-831cb32630ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:47.498032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87135-49d3-4c12-89c4-831cb32630ff None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:47.502389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1a692-178b-4ef6-a479-bfbdd50583c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:47.503607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1a692-178b-4ef6-a479-bfbdd50583c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:47.503887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1a692-178b-4ef6-a479-bfbdd50583c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:47.504262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1a692-178b-4ef6-a479-bfbdd50583c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:47.513444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1a692-178b-4ef6-a479-bfbdd50583c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:47.515400 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1a692-178b-4ef6-a479-bfbdd50583c5 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:47.525057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 664/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:52.649666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae5b86-0e6a-4040-ad66-5eedb9da038b None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:52.650423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae5b86-0e6a-4040-ad66-5eedb9da038b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:52.650423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae5b86-0e6a-4040-ad66-5eedb9da038b None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:52.651700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 677/1341] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:30:52.657780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74b10-4522-4ffb-9f59-a373c26ee638 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:52.658260 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74b10-4522-4ffb-9f59-a373c26ee638 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:52.658376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74b10-4522-4ffb-9f59-a373c26ee638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:52.694249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bee74b10-4522-4ffb-9f59-a373c26ee638 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:52.695467 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bee74b10-4522-4ffb-9f59-a373c26ee638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:52.787730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 665/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:52.827351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae5b86-0e6a-4040-ad66-5eedb9da038b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:52.829250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d6ae5b86-0e6a-4040-ad66-5eedb9da038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:52.842416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae5b86-0e6a-4040-ad66-5eedb9da038b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:52.846677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60242dda-107d-420d-b75a-fcc620c64020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:52.847332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60242dda-107d-420d-b75a-fcc620c64020 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:52.847611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60242dda-107d-420d-b75a-fcc620c64020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:52.847884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60242dda-107d-420d-b75a-fcc620c64020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:52.858005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60242dda-107d-420d-b75a-fcc620c64020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:52.859437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60242dda-107d-420d-b75a-fcc620c64020 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:52.870116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 678/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:30:56.254091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f562e4-d679-4a1d-9a76-81e4b1e40f68 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:56.254676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f562e4-d679-4a1d-9a76-81e4b1e40f68 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:56.254676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f562e4-d679-4a1d-9a76-81e4b1e40f68 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:56.256066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 666/1344] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:30:56.263361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222012a-8226-4d57-b1a3-c6fcd421a6ab None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:56.263974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222012a-8226-4d57-b1a3-c6fcd421a6ab None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:56.264898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222012a-8226-4d57-b1a3-c6fcd421a6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:56.303071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6222012a-8226-4d57-b1a3-c6fcd421a6ab None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:30:56.304937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6222012a-8226-4d57-b1a3-c6fcd421a6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:30:56.317416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 679/1345] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:30:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:30:56.375039 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f562e4-d679-4a1d-9a76-81e4b1e40f68 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:30:56.391336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f562e4-d679-4a1d-9a76-81e4b1e40f68 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:30:56.399102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc319a4-efb7-4fbd-8bf5-a8b7861c22e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:30:56.399102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc319a4-efb7-4fbd-8bf5-a8b7861c22e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:30:56.399102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc319a4-efb7-4fbd-8bf5-a8b7861c22e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:30:56.400372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc319a4-efb7-4fbd-8bf5-a8b7861c22e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:30:56.411011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc319a4-efb7-4fbd-8bf5-a8b7861c22e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:30:56.412499 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc319a4-efb7-4fbd-8bf5-a8b7861c22e7 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:30:56.424569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 667/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:30:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:31:01.302360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52230cb-eff4-42cf-9f7b-812464fe7025 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:01.302929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52230cb-eff4-42cf-9f7b-812464fe7025 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:01.302929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52230cb-eff4-42cf-9f7b-812464fe7025 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:01.304337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 680/1347] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:01.309873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96968218-ae36-487e-9d6a-e6289d5076a4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:01.310363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96968218-ae36-487e-9d6a-e6289d5076a4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:01.310486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96968218-ae36-487e-9d6a-e6289d5076a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:01.330198 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-96968218-ae36-487e-9d6a-e6289d5076a4 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:01.331491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-96968218-ae36-487e-9d6a-e6289d5076a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:01.339509 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 668/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:01.380556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52230cb-eff4-42cf-9f7b-812464fe7025 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:01.392787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52230cb-eff4-42cf-9f7b-812464fe7025 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:01.396481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f75519-248a-473f-89ac-4665333c02e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:01.397136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75519-248a-473f-89ac-4665333c02e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:01.397419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75519-248a-473f-89ac-4665333c02e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:01.397691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75519-248a-473f-89ac-4665333c02e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:01.407568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f75519-248a-473f-89ac-4665333c02e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:01.409053 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f75519-248a-473f-89ac-4665333c02e9 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:01.419254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 681/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:07.028878 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaca1b-9cef-493a-aa32-9624853df711 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:07.029616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaca1b-9cef-493a-aa32-9624853df711 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:07.029616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaca1b-9cef-493a-aa32-9624853df711 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:07.031452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 669/1350] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:07.036616 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea769a70-21e8-4195-b79a-847d34d9e9a4 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:07.037094 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea769a70-21e8-4195-b79a-847d34d9e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:07.037202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea769a70-21e8-4195-b79a-847d34d9e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:07.114743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ea769a70-21e8-4195-b79a-847d34d9e9a4 None None] MFA Rules not processed for user `a2909d4015ac45fcaf6d1fc8e488aa44`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:07.115849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ea769a70-21e8-4195-b79a-847d34d9e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:07.175532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:07.202699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 682/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:31:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:11.324016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:11.969590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640740d5-6484-44cf-8a94-71cd6a1f4414 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:11.969897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640740d5-6484-44cf-8a94-71cd6a1f4414 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:11.970157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640740d5-6484-44cf-8a94-71cd6a1f4414 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:11.972394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 670/1352] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:31:11.979140 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efc91e-dff3-403b-878c-5704d6f4bb0c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:11.979960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efc91e-dff3-403b-878c-5704d6f4bb0c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:11.980435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efc91e-dff3-403b-878c-5704d6f4bb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:12.001915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-06efc91e-dff3-403b-878c-5704d6f4bb0c None None] MFA Rules not processed for user `a2909d4015ac45fcaf6d1fc8e488aa44`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:12.003795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-06efc91e-dff3-403b-878c-5704d6f4bb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:12.014273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 683/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:31:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:13.422422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbf862-8290-4809-a4b8-1a943e3ed0b6 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:13.422944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbf862-8290-4809-a4b8-1a943e3ed0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:13.422944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbf862-8290-4809-a4b8-1a943e3ed0b6 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:13.424285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 671/1354] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:13.429548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6c258-6ea2-49ec-8619-cf6317eb0c5a None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:13.430027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6c258-6ea2-49ec-8619-cf6317eb0c5a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:13.430196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6c258-6ea2-49ec-8619-cf6317eb0c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:13.448927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4bf6c258-6ea2-49ec-8619-cf6317eb0c5a None None] MFA Rules not processed for user `a2909d4015ac45fcaf6d1fc8e488aa44`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:13.450127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4bf6c258-6ea2-49ec-8619-cf6317eb0c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:13.458892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 684/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:31:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:17.426426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6c4a-759a-4305-9f12-c5a33e098eef None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:17.426979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6c4a-759a-4305-9f12-c5a33e098eef None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:17.426979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6c4a-759a-4305-9f12-c5a33e098eef None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:17.430606 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 672/1356] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:17.435510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae7f0-f01c-4ff4-af67-4384c33652a7 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:17.436206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae7f0-f01c-4ff4-af67-4384c33652a7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:17.436206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae7f0-f01c-4ff4-af67-4384c33652a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:17.457628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-802ae7f0-f01c-4ff4-af67-4384c33652a7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:17.458844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-802ae7f0-f01c-4ff4-af67-4384c33652a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:17.469295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 685/1357] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:31:17.529451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5bdfd-a7da-4b30-a6b3-68e0e5a6a2bd None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:17.530090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5bdfd-a7da-4b30-a6b3-68e0e5a6a2bd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:17.530528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5bdfd-a7da-4b30-a6b3-68e0e5a6a2bd None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:17.533479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 673/1358] 10.222.0.77 () {54 vars in 961 bytes} [Thu Jun 16 17:31:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:17.541591 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3873ba-88da-42fa-a45c-74059d770494 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:17.542584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3873ba-88da-42fa-a45c-74059d770494 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:17.547996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3873ba-88da-42fa-a45c-74059d770494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:17.619608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4a3873ba-88da-42fa-a45c-74059d770494 None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:17.622386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4a3873ba-88da-42fa-a45c-74059d770494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:17.750281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 686/1359] 10.222.0.77 () {58 vars in 1058 bytes} [Thu Jun 16 17:31:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:31:17.764103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5bdfd-a7da-4b30-a6b3-68e0e5a6a2bd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:17.787864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5bdfd-a7da-4b30-a6b3-68e0e5a6a2bd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:17.796203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9240f4-edac-46b2-9fcc-e01c54b75613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:17.797202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9240f4-edac-46b2-9fcc-e01c54b75613 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:17.797629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9240f4-edac-46b2-9fcc-e01c54b75613 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:17.798046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9240f4-edac-46b2-9fcc-e01c54b75613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:17.814040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9240f4-edac-46b2-9fcc-e01c54b75613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:17.817136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9240f4-edac-46b2-9fcc-e01c54b75613 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:17.837133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 674/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:20.315085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75872292-48da-4785-843b-57e2d35c8ad4 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:20.315662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75872292-48da-4785-843b-57e2d35c8ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:20.315662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75872292-48da-4785-843b-57e2d35c8ad4 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:20.317299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 687/1361] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:20.323288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf85ffb-34e3-4a99-bba6-cab72091159d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:20.323837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf85ffb-34e3-4a99-bba6-cab72091159d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:20.324010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf85ffb-34e3-4a99-bba6-cab72091159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:20.344704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-faf85ffb-34e3-4a99-bba6-cab72091159d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:20.346003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-faf85ffb-34e3-4a99-bba6-cab72091159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:20.354784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 675/1362] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:20.402244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75872292-48da-4785-843b-57e2d35c8ad4 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:20.419643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75872292-48da-4785-843b-57e2d35c8ad4 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:20.432131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b6ac4-7ed2-49f4-a443-c3f9f7c01149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:20.433984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b6ac4-7ed2-49f4-a443-c3f9f7c01149 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:20.434531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b6ac4-7ed2-49f4-a443-c3f9f7c01149 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:20.435110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b6ac4-7ed2-49f4-a443-c3f9f7c01149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:20.446494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b6ac4-7ed2-49f4-a443-c3f9f7c01149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:20.448200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b6ac4-7ed2-49f4-a443-c3f9f7c01149 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:20.459867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 688/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:23.183426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24c630-3fa9-4843-a6c3-abbbb0f90131 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:23.183968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24c630-3fa9-4843-a6c3-abbbb0f90131 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:23.183968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24c630-3fa9-4843-a6c3-abbbb0f90131 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:23.186136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 676/1364] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:23.191678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefb624-9a3d-404a-bfe8-d5acb5a515d0 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:23.192129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefb624-9a3d-404a-bfe8-d5acb5a515d0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:23.192251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefb624-9a3d-404a-bfe8-d5acb5a515d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:23.212242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-efefb624-9a3d-404a-bfe8-d5acb5a515d0 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:23.213454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-efefb624-9a3d-404a-bfe8-d5acb5a515d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:23.222784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 689/1365] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:31:23.276199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd561f16-5cf3-4ba3-bfcd-298ce32ccabd None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:23.276199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd561f16-5cf3-4ba3-bfcd-298ce32ccabd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:23.276199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd561f16-5cf3-4ba3-bfcd-298ce32ccabd None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:23.276948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 677/1366] 10.222.0.77 () {54 vars in 961 bytes} [Thu Jun 16 17:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:23.282730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412942e-5518-451f-a96b-7834cf6e1126 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:23.283018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412942e-5518-451f-a96b-7834cf6e1126 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:23.283307 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412942e-5518-451f-a96b-7834cf6e1126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:23.303518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-8412942e-5518-451f-a96b-7834cf6e1126 None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:23.304694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8412942e-5518-451f-a96b-7834cf6e1126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:23.315426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 690/1367] 10.222.0.77 () {58 vars in 1058 bytes} [Thu Jun 16 17:31:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:23.323456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd561f16-5cf3-4ba3-bfcd-298ce32ccabd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:23.339042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd561f16-5cf3-4ba3-bfcd-298ce32ccabd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:23.345276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd22507-84b7-4944-b198-f41e9bdb7b2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:23.345914 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd22507-84b7-4944-b198-f41e9bdb7b2c service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:23.346203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd22507-84b7-4944-b198-f41e9bdb7b2c service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:23.346477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd22507-84b7-4944-b198-f41e9bdb7b2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:23.355955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd22507-84b7-4944-b198-f41e9bdb7b2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:23.357750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd22507-84b7-4944-b198-f41e9bdb7b2c service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:23.367873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 678/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:25.911848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9625087-c2f4-4c0f-b100-5f56c52c0a5f None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:25.912436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9625087-c2f4-4c0f-b100-5f56c52c0a5f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:25.912523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9625087-c2f4-4c0f-b100-5f56c52c0a5f None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:25.913973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 691/1369] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:25.919399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211943bc-a008-4074-be7f-0ba9c9e82074 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:25.919839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211943bc-a008-4074-be7f-0ba9c9e82074 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:25.919963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211943bc-a008-4074-be7f-0ba9c9e82074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:25.940057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-211943bc-a008-4074-be7f-0ba9c9e82074 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:25.941753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-211943bc-a008-4074-be7f-0ba9c9e82074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:25.951021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 679/1370] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:26.005125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9625087-c2f4-4c0f-b100-5f56c52c0a5f None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:26.021171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9625087-c2f4-4c0f-b100-5f56c52c0a5f None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:26.027258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302ed90-c1c5-455f-a949-df9c1bd8878b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:26.028916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ed90-c1c5-455f-a949-df9c1bd8878b service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:26.029663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ed90-c1c5-455f-a949-df9c1bd8878b service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:26.030150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ed90-c1c5-455f-a949-df9c1bd8878b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:26.040381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302ed90-c1c5-455f-a949-df9c1bd8878b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:26.042518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302ed90-c1c5-455f-a949-df9c1bd8878b service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:26.054384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 692/1371] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:26.076221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c638f-4936-40a3-b2b6-0960eb0e335e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:26.079658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c638f-4936-40a3-b2b6-0960eb0e335e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:26.079658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c638f-4936-40a3-b2b6-0960eb0e335e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:26.079658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 680/1372] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:26.083950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af78a9-460b-48f1-a29b-898199d56565 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:26.084293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af78a9-460b-48f1-a29b-898199d56565 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:26.084581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af78a9-460b-48f1-a29b-898199d56565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:26.105165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-56af78a9-460b-48f1-a29b-898199d56565 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:26.108438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-56af78a9-460b-48f1-a29b-898199d56565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:26.116288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 693/1373] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:26.430861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad863-bc32-43e9-80c0-a39040f3e835 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:26.431902 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad863-bc32-43e9-80c0-a39040f3e835 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:26.431902 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad863-bc32-43e9-80c0-a39040f3e835 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:26.433103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 681/1374] 10.222.0.77 () {54 vars in 963 bytes} [Thu Jun 16 17:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:26.438427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531047-4f5e-4903-96fb-5c27c9920e85 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:26.438716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531047-4f5e-4903-96fb-5c27c9920e85 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:26.438993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531047-4f5e-4903-96fb-5c27c9920e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:26.493358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d4531047-4f5e-4903-96fb-5c27c9920e85 None None] MFA Rules not processed for user `adf46b0ab3b9400d8fc44ba3a1574f27`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:26.494742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d4531047-4f5e-4903-96fb-5c27c9920e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:26.500026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:26.565171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 694/1375] 10.222.0.77 () {58 vars in 1060 bytes} [Thu Jun 16 17:31:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:26.572441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ad863-bc32-43e9-80c0-a39040f3e835 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:26.585586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ad863-bc32-43e9-80c0-a39040f3e835 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:26.589491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f8f50-bbaf-4e55-83a9-58210949e10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:26.590342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8f50-bbaf-4e55-83a9-58210949e10b service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:26.594565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8f50-bbaf-4e55-83a9-58210949e10b service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:26.594565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8f50-bbaf-4e55-83a9-58210949e10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:26.601715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f8f50-bbaf-4e55-83a9-58210949e10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:26.603633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f8f50-bbaf-4e55-83a9-58210949e10b service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:26.613968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 682/1376] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:31:28.425807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb0be0-c847-4c3d-af80-3254dc3779de None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:28.426354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb0be0-c847-4c3d-af80-3254dc3779de None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:28.426354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb0be0-c847-4c3d-af80-3254dc3779de None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:28.427854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 695/1377] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:28.434075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af131565-91cb-4f62-86b7-610135af2185 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:28.436067 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af131565-91cb-4f62-86b7-610135af2185 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:28.436067 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af131565-91cb-4f62-86b7-610135af2185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:28.456133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-af131565-91cb-4f62-86b7-610135af2185 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:28.457558 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-af131565-91cb-4f62-86b7-610135af2185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:28.466118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 683/1378] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:28.514424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb0be0-c847-4c3d-af80-3254dc3779de None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:28.529700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb0be0-c847-4c3d-af80-3254dc3779de None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:28.535205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2006d-b8c7-4c90-b8ae-e491e3157085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:28.535864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2006d-b8c7-4c90-b8ae-e491e3157085 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:28.536171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2006d-b8c7-4c90-b8ae-e491e3157085 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:28.536447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2006d-b8c7-4c90-b8ae-e491e3157085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:28.545582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2006d-b8c7-4c90-b8ae-e491e3157085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:28.547198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2006d-b8c7-4c90-b8ae-e491e3157085 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:28.557826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 696/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:30.981624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a588374-7da3-4a8e-a743-77b466d9ba82 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:30.982211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a588374-7da3-4a8e-a743-77b466d9ba82 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:30.982211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a588374-7da3-4a8e-a743-77b466d9ba82 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:30.983554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 684/1380] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:30.989044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4497-dbe9-4584-b0a5-f4ebc75d630b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:30.989503 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4497-dbe9-4584-b0a5-f4ebc75d630b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:30.989584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4497-dbe9-4584-b0a5-f4ebc75d630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:31.009795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-621d4497-dbe9-4584-b0a5-f4ebc75d630b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:31.011154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-621d4497-dbe9-4584-b0a5-f4ebc75d630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:31.019603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 697/1381] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:31.064866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a588374-7da3-4a8e-a743-77b466d9ba82 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:31.080524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a588374-7da3-4a8e-a743-77b466d9ba82 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:31.086586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd0a10-5c3a-424f-858c-8cf1ed3ad02c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:31.087426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd0a10-5c3a-424f-858c-8cf1ed3ad02c service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:31.087863 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd0a10-5c3a-424f-858c-8cf1ed3ad02c service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:31.088590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd0a10-5c3a-424f-858c-8cf1ed3ad02c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:31.098730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd0a10-5c3a-424f-858c-8cf1ed3ad02c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:31.100543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd0a10-5c3a-424f-858c-8cf1ed3ad02c service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:31.112699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 685/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:33.668032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c446b-d754-45e5-a3c8-66a839c2949c None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:33.669297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c446b-d754-45e5-a3c8-66a839c2949c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:33.669492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c446b-d754-45e5-a3c8-66a839c2949c None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:33.672862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 698/1383] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:33.678581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b8f0-a82d-4f07-be1c-3cc9982504fa None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:33.679080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b8f0-a82d-4f07-be1c-3cc9982504fa None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:33.685340 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b8f0-a82d-4f07-be1c-3cc9982504fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:33.702767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3704b8f0-a82d-4f07-be1c-3cc9982504fa None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:33.704243 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3704b8f0-a82d-4f07-be1c-3cc9982504fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:33.714391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 686/1384] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:33.759539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c446b-d754-45e5-a3c8-66a839c2949c None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:33.775859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c446b-d754-45e5-a3c8-66a839c2949c None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:33.784618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fe03e-37c8-44f7-a49c-6746e7d93cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:33.786026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fe03e-37c8-44f7-a49c-6746e7d93cd2 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:33.786707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fe03e-37c8-44f7-a49c-6746e7d93cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:33.787392 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fe03e-37c8-44f7-a49c-6746e7d93cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:33.804730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fe03e-37c8-44f7-a49c-6746e7d93cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:33.808135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fe03e-37c8-44f7-a49c-6746e7d93cd2 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:33.827697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 699/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:36.124961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfb923-4fd3-4c0c-a2cb-b8ea4d19d5ad None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:36.125705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfb923-4fd3-4c0c-a2cb-b8ea4d19d5ad None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:36.125705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfb923-4fd3-4c0c-a2cb-b8ea4d19d5ad None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:36.127232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 687/1386] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:36.133687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406a0c-1d61-45fb-ae76-0fd69bd5aa6e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:36.134179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406a0c-1d61-45fb-ae76-0fd69bd5aa6e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:36.134409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406a0c-1d61-45fb-ae76-0fd69bd5aa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:36.155440 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-8a406a0c-1d61-45fb-ae76-0fd69bd5aa6e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:36.156689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8a406a0c-1d61-45fb-ae76-0fd69bd5aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:36.165297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 700/1387] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:36.213870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfb923-4fd3-4c0c-a2cb-b8ea4d19d5ad None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:36.231390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfb923-4fd3-4c0c-a2cb-b8ea4d19d5ad None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:36.238597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47fd6e-9c7b-4408-89c5-7925281a0e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:36.239414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47fd6e-9c7b-4408-89c5-7925281a0e68 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:36.239764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47fd6e-9c7b-4408-89c5-7925281a0e68 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:36.240571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47fd6e-9c7b-4408-89c5-7925281a0e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:36.252877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47fd6e-9c7b-4408-89c5-7925281a0e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:36.254942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47fd6e-9c7b-4408-89c5-7925281a0e68 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:36.268965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 688/1388] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:38.849321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7925f20-cbb3-49f5-a0d3-931b44f30cfc None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:38.850018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7925f20-cbb3-49f5-a0d3-931b44f30cfc None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:38.850018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7925f20-cbb3-49f5-a0d3-931b44f30cfc None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:38.851206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 701/1389] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:38.857269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889379-1df2-4cf8-9b95-a2d441ad83da None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:38.857740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889379-1df2-4cf8-9b95-a2d441ad83da None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:38.857988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889379-1df2-4cf8-9b95-a2d441ad83da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:38.880920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0d889379-1df2-4cf8-9b95-a2d441ad83da None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:38.882700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0d889379-1df2-4cf8-9b95-a2d441ad83da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:38.893446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 689/1390] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:38.941599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7925f20-cbb3-49f5-a0d3-931b44f30cfc None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:38.962583 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7925f20-cbb3-49f5-a0d3-931b44f30cfc None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:38.969843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22915a5-e4c4-41f2-92ec-286f078b9421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:38.970924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22915a5-e4c4-41f2-92ec-286f078b9421 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:38.971117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22915a5-e4c4-41f2-92ec-286f078b9421 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:38.971363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22915a5-e4c4-41f2-92ec-286f078b9421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:38.981480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22915a5-e4c4-41f2-92ec-286f078b9421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:38.983347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22915a5-e4c4-41f2-92ec-286f078b9421 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:38.993810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 702/1391] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:41.743777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093779-85e2-45a5-bc86-ce469c94d961 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:41.744377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093779-85e2-45a5-bc86-ce469c94d961 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:41.744377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093779-85e2-45a5-bc86-ce469c94d961 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:41.746018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 690/1392] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:41.752414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399ccb6-e924-4560-aba5-3d840c4fd98e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:41.753242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399ccb6-e924-4560-aba5-3d840c4fd98e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:41.753416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399ccb6-e924-4560-aba5-3d840c4fd98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:41.776550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9399ccb6-e924-4560-aba5-3d840c4fd98e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:41.777838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9399ccb6-e924-4560-aba5-3d840c4fd98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:41.786269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 703/1393] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:41.834079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19093779-85e2-45a5-bc86-ce469c94d961 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:41.842180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=46 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:41.849643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19093779-85e2-45a5-bc86-ce469c94d961 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:41.855400 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b1776-94a0-41fb-b4a7-da37b9d196fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:41.856607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b1776-94a0-41fb-b4a7-da37b9d196fd service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:41.856887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b1776-94a0-41fb-b4a7-da37b9d196fd service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:41.857159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b1776-94a0-41fb-b4a7-da37b9d196fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:41.866294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b1776-94a0-41fb-b4a7-da37b9d196fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:41.867875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b1776-94a0-41fb-b4a7-da37b9d196fd service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:41.890729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 691/1394] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:42.762003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790284e-ae5f-43b0-ba95-63200c682e85 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:42.762667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790284e-ae5f-43b0-ba95-63200c682e85 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:42.762667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790284e-ae5f-43b0-ba95-63200c682e85 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:42.763991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 704/1395] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:42.770063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a7d8-f16c-4e95-ba2e-e3ca8c2f6392 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:42.770621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a7d8-f16c-4e95-ba2e-e3ca8c2f6392 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:42.770727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a7d8-f16c-4e95-ba2e-e3ca8c2f6392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:42.789107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ed29a7d8-f16c-4e95-ba2e-e3ca8c2f6392 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:42.790321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ed29a7d8-f16c-4e95-ba2e-e3ca8c2f6392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:42.799221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 692/1396] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:42.858987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d6e2-3773-4ffb-afa3-c2cc299e3a3b None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:42.859449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d6e2-3773-4ffb-afa3-c2cc299e3a3b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:42.859602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d6e2-3773-4ffb-afa3-c2cc299e3a3b None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:42.860935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 705/1397] 10.222.0.77 () {54 vars in 962 bytes} [Thu Jun 16 17:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:42.866126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068716-b668-4e5d-9eea-c14542fbdbc9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:42.866418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068716-b668-4e5d-9eea-c14542fbdbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:42.866711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068716-b668-4e5d-9eea-c14542fbdbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:42.919603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b5068716-b668-4e5d-9eea-c14542fbdbc9 None None] MFA Rules not processed for user `dff915d0b23d4b9ebd70e6b6b885aca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:42.920817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b5068716-b668-4e5d-9eea-c14542fbdbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:42.989132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 693/1398] 10.222.0.77 () {58 vars in 1059 bytes} [Thu Jun 16 17:31:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:42.998374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d6e2-3773-4ffb-afa3-c2cc299e3a3b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:43.009681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d6e2-3773-4ffb-afa3-c2cc299e3a3b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:43.014006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ed6bb-0980-47c3-86a9-ea61469ddcca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff915d0b23d4b9ebd70e6b6b885aca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:43.014676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ed6bb-0980-47c3-86a9-ea61469ddcca service glance] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:43.014956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ed6bb-0980-47c3-86a9-ea61469ddcca service glance] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:43.015231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ed6bb-0980-47c3-86a9-ea61469ddcca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:43.025100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ed6bb-0980-47c3-86a9-ea61469ddcca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:43.026620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ed6bb-0980-47c3-86a9-ea61469ddcca service glance] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:43.039181 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 706/1399] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:31:43.990817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf44ad-79fe-4346-ab58-838855cb2cba None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:43.991341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf44ad-79fe-4346-ab58-838855cb2cba None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:43.991580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf44ad-79fe-4346-ab58-838855cb2cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:44.055279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8eaf44ad-79fe-4346-ab58-838855cb2cba None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:44.056676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8eaf44ad-79fe-4346-ab58-838855cb2cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:44.139728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 694/1400] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:31:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:44.182416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffb20e-58e2-4b42-9bcb-ddd309fecd43 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:44.182940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffb20e-58e2-4b42-9bcb-ddd309fecd43 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:44.183051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffb20e-58e2-4b42-9bcb-ddd309fecd43 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:44.184669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 707/1401] 10.222.0.77 () {54 vars in 942 bytes} [Thu Jun 16 17:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:44.192097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f9116-bdbe-415d-96ee-5fbf8bf6dc91 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:44.192547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f9116-bdbe-415d-96ee-5fbf8bf6dc91 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:44.192875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f9116-bdbe-415d-96ee-5fbf8bf6dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:44.251735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:44.255436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-750f9116-bdbe-415d-96ee-5fbf8bf6dc91 None None] MFA Rules not processed for user `e3c319430309419c895a0dc3c90ce80e`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:44.257185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-750f9116-bdbe-415d-96ee-5fbf8bf6dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:44.336465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 695/1402] 10.222.0.77 () {58 vars in 1039 bytes} [Thu Jun 16 17:31:44 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:44.346756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffb20e-58e2-4b42-9bcb-ddd309fecd43 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:44.362821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffb20e-58e2-4b42-9bcb-ddd309fecd43 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:44.368434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa2a50-867a-4629-a701-27cdcfa5848e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:44.369113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2a50-867a-4629-a701-27cdcfa5848e service swift] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:44.369400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2a50-867a-4629-a701-27cdcfa5848e service swift] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:44.369676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2a50-867a-4629-a701-27cdcfa5848e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:44.379681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa2a50-867a-4629-a701-27cdcfa5848e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:44.381354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa2a50-867a-4629-a701-27cdcfa5848e service swift] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:44.391843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 708/1403] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:31:44.438463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf22b2e-1847-40d4-be30-785629c2131e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:44.438796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf22b2e-1847-40d4-be30-785629c2131e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:44.439078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf22b2e-1847-40d4-be30-785629c2131e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:44.440539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 696/1404] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:31:44.446511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafefd2-15b9-40e9-9914-3d6936540b89 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:44.446825 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafefd2-15b9-40e9-9914-3d6936540b89 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:44.447110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafefd2-15b9-40e9-9914-3d6936540b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:44.466559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-7eafefd2-15b9-40e9-9914-3d6936540b89 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:44.470741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7eafefd2-15b9-40e9-9914-3d6936540b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:44.475669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 709/1405] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:44.522712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf22b2e-1847-40d4-be30-785629c2131e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:44.538626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf22b2e-1847-40d4-be30-785629c2131e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:44.544641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0bd7c-fc76-47f3-a928-1dc651a32dd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:44.545287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0bd7c-fc76-47f3-a928-1dc651a32dd0 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:44.545572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0bd7c-fc76-47f3-a928-1dc651a32dd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:44.545849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0bd7c-fc76-47f3-a928-1dc651a32dd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:44.555457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0bd7c-fc76-47f3-a928-1dc651a32dd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:44.557135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0bd7c-fc76-47f3-a928-1dc651a32dd0 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:44.569493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 697/1406] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:47.074875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd437842-89dc-469b-8c99-9bef6ff5804a None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:47.075564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd437842-89dc-469b-8c99-9bef6ff5804a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:47.075564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd437842-89dc-469b-8c99-9bef6ff5804a None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:47.080682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 710/1407] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:31:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:31:47.082685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c118eb-3a36-4bee-a61f-6cdbfa7555fa None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:47.083159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c118eb-3a36-4bee-a61f-6cdbfa7555fa None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:47.083251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c118eb-3a36-4bee-a61f-6cdbfa7555fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:47.102877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b8c118eb-3a36-4bee-a61f-6cdbfa7555fa None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:31:47.104134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b8c118eb-3a36-4bee-a61f-6cdbfa7555fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:31:47.112844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 698/1408] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:31:47.167582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd437842-89dc-469b-8c99-9bef6ff5804a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:31:47.183012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd437842-89dc-469b-8c99-9bef6ff5804a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:31:47.189467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38cb1-ad71-4594-8319-81ae6f16dc27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:31:47.190495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38cb1-ad71-4594-8319-81ae6f16dc27 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:31:47.190886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38cb1-ad71-4594-8319-81ae6f16dc27 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:31:47.191199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38cb1-ad71-4594-8319-81ae6f16dc27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:31:47.201266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38cb1-ad71-4594-8319-81ae6f16dc27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:31:47.202861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38cb1-ad71-4594-8319-81ae6f16dc27 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:31:47.216622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 711/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:31:57.096906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=39 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:31:57.210908 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=71 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:09.255539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ce94d-8407-4a6b-84fb-f6a302a85d1b None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:09.256046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ce94d-8407-4a6b-84fb-f6a302a85d1b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:09.256046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ce94d-8407-4a6b-84fb-f6a302a85d1b None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:09.257423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 699/1410] 10.222.0.77 () {54 vars in 918 bytes} [Thu Jun 16 17:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:09.269260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e27501-3d70-48f1-9f30-3dda6660e070 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:09.269796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e27501-3d70-48f1-9f30-3dda6660e070 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:09.269796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e27501-3d70-48f1-9f30-3dda6660e070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:09.289889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-b5e27501-3d70-48f1-9f30-3dda6660e070 None None] MFA Rules not processed for user `a2909d4015ac45fcaf6d1fc8e488aa44`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:09.291190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b5e27501-3d70-48f1-9f30-3dda6660e070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:09.303463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 712/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Thu Jun 16 17:32:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:09.322897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c0a0-3f1e-4c41-a13c-dd5648c1c2e1 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:09.323969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c0a0-3f1e-4c41-a13c-dd5648c1c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:09.324718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c0a0-3f1e-4c41-a13c-dd5648c1c2e1 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:09.328725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 700/1412] 10.222.0.77 () {54 vars in 918 bytes} [Thu Jun 16 17:32:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:09.335071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3ad80-8157-407d-a438-149d2c533171 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:09.335363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3ad80-8157-407d-a438-149d2c533171 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:09.335682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3ad80-8157-407d-a438-149d2c533171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:09.356667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-fcc3ad80-8157-407d-a438-149d2c533171 None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:09.357918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fcc3ad80-8157-407d-a438-149d2c533171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:09.368999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 713/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Thu Jun 16 17:32:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:12.141269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dbc14-63f4-4418-a643-6bf9677167c5 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:12.142120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dbc14-63f4-4418-a643-6bf9677167c5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:12.142120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dbc14-63f4-4418-a643-6bf9677167c5 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:12.143178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:32:12.148941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280a9c-ea6b-4bf6-992e-006ce459bdba None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:12.149761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280a9c-ea6b-4bf6-992e-006ce459bdba None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:12.149761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280a9c-ea6b-4bf6-992e-006ce459bdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:12.170765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-97280a9c-ea6b-4bf6-992e-006ce459bdba None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:12.171991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-97280a9c-ea6b-4bf6-992e-006ce459bdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:12.180521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:12.230402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dbc14-63f4-4418-a643-6bf9677167c5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:12.247147 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dbc14-63f4-4418-a643-6bf9677167c5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:12.253465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c1d58-dcd0-4482-bbe0-b7b24873a330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:12.254395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1d58-dcd0-4482-bbe0-b7b24873a330 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:12.254695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1d58-dcd0-4482-bbe0-b7b24873a330 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:12.254976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1d58-dcd0-4482-bbe0-b7b24873a330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:12.267152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c1d58-dcd0-4482-bbe0-b7b24873a330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:12.269480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c1d58-dcd0-4482-bbe0-b7b24873a330 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:12.284034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 702/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:13.329977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acacd48-8eeb-439e-812c-83436f57f1c9 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:13.330501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acacd48-8eeb-439e-812c-83436f57f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:13.330501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acacd48-8eeb-439e-812c-83436f57f1c9 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:13.331945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:32:13.337402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6346ac-a6b3-49b3-a892-a6c869199418 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:13.337894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6346ac-a6b3-49b3-a892-a6c869199418 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:13.337996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6346ac-a6b3-49b3-a892-a6c869199418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:13.359396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ea6346ac-a6b3-49b3-a892-a6c869199418 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:13.361004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ea6346ac-a6b3-49b3-a892-a6c869199418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:13.369394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:13.571142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acacd48-8eeb-439e-812c-83436f57f1c9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:13.587785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acacd48-8eeb-439e-812c-83436f57f1c9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:13.594816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f85541-4628-4589-a888-1c4df7b040f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:13.595505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85541-4628-4589-a888-1c4df7b040f0 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:13.595792 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85541-4628-4589-a888-1c4df7b040f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:13.596170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85541-4628-4589-a888-1c4df7b040f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:13.605892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f85541-4628-4589-a888-1c4df7b040f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:13.607563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f85541-4628-4589-a888-1c4df7b040f0 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:13.618263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 716/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:14.626813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc7ce-cb44-4bb9-a712-c92101739d1b None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:14.627713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc7ce-cb44-4bb9-a712-c92101739d1b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:14.628261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc7ce-cb44-4bb9-a712-c92101739d1b None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:14.630012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:14.637380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa72a0-f3c1-414f-9d40-8d1bc756dedb None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:14.637843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa72a0-f3c1-414f-9d40-8d1bc756dedb None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:14.637967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa72a0-f3c1-414f-9d40-8d1bc756dedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:14.658658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-7dfa72a0-f3c1-414f-9d40-8d1bc756dedb None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:14.659886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7dfa72a0-f3c1-414f-9d40-8d1bc756dedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:14.670228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:14.869234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc7ce-cb44-4bb9-a712-c92101739d1b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:14.884495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc7ce-cb44-4bb9-a712-c92101739d1b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:14.891181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdc5db-3d6d-4e34-8e43-8ca820d29f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:14.891859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdc5db-3d6d-4e34-8e43-8ca820d29f72 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:14.892351 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdc5db-3d6d-4e34-8e43-8ca820d29f72 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:14.893381 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdc5db-3d6d-4e34-8e43-8ca820d29f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:14.904055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdc5db-3d6d-4e34-8e43-8ca820d29f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:14.905753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdc5db-3d6d-4e34-8e43-8ca820d29f72 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:14.917838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 705/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:15.938246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f7b1b-5db7-40b0-bd73-62b73c0e5d78 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:15.938922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f7b1b-5db7-40b0-bd73-62b73c0e5d78 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:15.938922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f7b1b-5db7-40b0-bd73-62b73c0e5d78 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:15.940417 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:15.945721 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e50ad4-a1a5-4407-aecb-1991e5762a5b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:15.946187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e50ad4-a1a5-4407-aecb-1991e5762a5b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:15.946318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e50ad4-a1a5-4407-aecb-1991e5762a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:15.965744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e9e50ad4-a1a5-4407-aecb-1991e5762a5b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:15.966798 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e9e50ad4-a1a5-4407-aecb-1991e5762a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:15.974854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:16.130558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f7b1b-5db7-40b0-bd73-62b73c0e5d78 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:16.145563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f7b1b-5db7-40b0-bd73-62b73c0e5d78 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:16.151437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e8cdd-5424-4456-9c4e-958928c34cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:16.152098 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8cdd-5424-4456-9c4e-958928c34cb2 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:16.152408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8cdd-5424-4456-9c4e-958928c34cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:16.152682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8cdd-5424-4456-9c4e-958928c34cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:16.161244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e8cdd-5424-4456-9c4e-958928c34cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:16.162829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e8cdd-5424-4456-9c4e-958928c34cb2 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:16.173485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 719/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:17.123525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc881-8c6a-4a9a-9536-8272050cf60f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:17.124159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc881-8c6a-4a9a-9536-8272050cf60f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:17.124159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc881-8c6a-4a9a-9536-8272050cf60f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:17.125500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:17.130600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba745c22-f698-4d6b-8e80-5c05d2ad69f0 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:17.131033 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba745c22-f698-4d6b-8e80-5c05d2ad69f0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:17.131149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba745c22-f698-4d6b-8e80-5c05d2ad69f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:17.149217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ba745c22-f698-4d6b-8e80-5c05d2ad69f0 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:17.150423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ba745c22-f698-4d6b-8e80-5c05d2ad69f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:17.158394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:17.320170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cc881-8c6a-4a9a-9536-8272050cf60f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:17.341740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cc881-8c6a-4a9a-9536-8272050cf60f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:17.349490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e195e5-b3b9-4460-8a44-4a2e240d3705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:17.350697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e195e5-b3b9-4460-8a44-4a2e240d3705 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:17.351115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e195e5-b3b9-4460-8a44-4a2e240d3705 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:17.351553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e195e5-b3b9-4460-8a44-4a2e240d3705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:17.364727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e195e5-b3b9-4460-8a44-4a2e240d3705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:17.367266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e195e5-b3b9-4460-8a44-4a2e240d3705 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:17.382315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 708/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:18.424251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e5b06-1d45-485c-9157-7120768fd682 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:18.424861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e5b06-1d45-485c-9157-7120768fd682 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:18.424861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e5b06-1d45-485c-9157-7120768fd682 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:18.426183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:18.431639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761c1e-f765-4a3e-858f-61b2bcfd8753 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:18.433270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761c1e-f765-4a3e-858f-61b2bcfd8753 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:18.433270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761c1e-f765-4a3e-858f-61b2bcfd8753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:18.453498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-11761c1e-f765-4a3e-858f-61b2bcfd8753 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:18.454696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-11761c1e-f765-4a3e-858f-61b2bcfd8753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:18.462672 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:18.616568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e5b06-1d45-485c-9157-7120768fd682 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:18.631802 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e5b06-1d45-485c-9157-7120768fd682 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:18.637175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d64599-75ff-4852-abff-7e54b5056582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:18.637903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d64599-75ff-4852-abff-7e54b5056582 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:18.638188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d64599-75ff-4852-abff-7e54b5056582 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:18.638460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d64599-75ff-4852-abff-7e54b5056582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:18.646760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d64599-75ff-4852-abff-7e54b5056582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:18.648358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d64599-75ff-4852-abff-7e54b5056582 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:18.658042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 722/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:19.615704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543077-679d-47ca-9842-7a40a94b13f3 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:19.616323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543077-679d-47ca-9842-7a40a94b13f3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:19.616323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543077-679d-47ca-9842-7a40a94b13f3 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:19.617631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:19.623185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebb5a8-330a-4948-ab26-7cbb9a6891f8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:19.623654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebb5a8-330a-4948-ab26-7cbb9a6891f8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:19.623770 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebb5a8-330a-4948-ab26-7cbb9a6891f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:19.642007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-deebb5a8-330a-4948-ab26-7cbb9a6891f8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:19.643261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-deebb5a8-330a-4948-ab26-7cbb9a6891f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:19.652476 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:19.806609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51543077-679d-47ca-9842-7a40a94b13f3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:19.822128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51543077-679d-47ca-9842-7a40a94b13f3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:19.828347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c13fe-c870-423b-9a85-c5fb6b0c50ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:19.828939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c13fe-c870-423b-9a85-c5fb6b0c50ab service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:19.829274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c13fe-c870-423b-9a85-c5fb6b0c50ab service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:19.829553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c13fe-c870-423b-9a85-c5fb6b0c50ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:19.838671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c13fe-c870-423b-9a85-c5fb6b0c50ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:19.840531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c13fe-c870-423b-9a85-c5fb6b0c50ab service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:19.851353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 711/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:20.840948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667071ec-e161-491d-8100-346045a91844 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:20.841544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667071ec-e161-491d-8100-346045a91844 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:20.841544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667071ec-e161-491d-8100-346045a91844 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:20.842810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:20.848285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbd0a8-9c09-4baa-847c-6893f8ff84ff None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:20.848839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbd0a8-9c09-4baa-847c-6893f8ff84ff None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:20.848839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbd0a8-9c09-4baa-847c-6893f8ff84ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:20.869664 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-54fbd0a8-9c09-4baa-847c-6893f8ff84ff None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:20.870938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-54fbd0a8-9c09-4baa-847c-6893f8ff84ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:20.879665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:21.035154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667071ec-e161-491d-8100-346045a91844 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:21.049223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667071ec-e161-491d-8100-346045a91844 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:21.054562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b65e68-6df8-4284-b1fe-8c7c1e448a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:21.055190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65e68-6df8-4284-b1fe-8c7c1e448a0e service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:21.055469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65e68-6df8-4284-b1fe-8c7c1e448a0e service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:21.055739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65e68-6df8-4284-b1fe-8c7c1e448a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:21.064473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b65e68-6df8-4284-b1fe-8c7c1e448a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:21.066044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b65e68-6df8-4284-b1fe-8c7c1e448a0e service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:21.076397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 725/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:22.012067 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1a5b9-ebcf-4a2e-a616-9b6737578383 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:22.012636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1a5b9-ebcf-4a2e-a616-9b6737578383 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:22.012636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1a5b9-ebcf-4a2e-a616-9b6737578383 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:22.013994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:22.019241 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1d8fa-2e09-400f-8698-14d953e398fb None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:22.019662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1d8fa-2e09-400f-8698-14d953e398fb None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:22.019805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1d8fa-2e09-400f-8698-14d953e398fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:22.038479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-cea1d8fa-2e09-400f-8698-14d953e398fb None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:22.039696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cea1d8fa-2e09-400f-8698-14d953e398fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:22.048730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:22.204855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1a5b9-ebcf-4a2e-a616-9b6737578383 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:22.219881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1a5b9-ebcf-4a2e-a616-9b6737578383 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:22.225498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405ad6c-1d52-4eab-9449-4de7d91399d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:22.226146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405ad6c-1d52-4eab-9449-4de7d91399d0 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:22.226422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405ad6c-1d52-4eab-9449-4de7d91399d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:22.226690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405ad6c-1d52-4eab-9449-4de7d91399d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:22.235790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405ad6c-1d52-4eab-9449-4de7d91399d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:22.237406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405ad6c-1d52-4eab-9449-4de7d91399d0 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:22.247731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 714/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:24.364667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461650-0858-4fbc-b590-80fc3134139a None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:24.365255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461650-0858-4fbc-b590-80fc3134139a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:24.365255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461650-0858-4fbc-b590-80fc3134139a None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:24.366510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:24.373019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422802a-34eb-4f59-852d-31ff6470382b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:24.373812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422802a-34eb-4f59-852d-31ff6470382b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:24.373812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422802a-34eb-4f59-852d-31ff6470382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:24.400704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e422802a-34eb-4f59-852d-31ff6470382b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:24.402511 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e422802a-34eb-4f59-852d-31ff6470382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:24.414341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:32:24.455364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82461650-0858-4fbc-b590-80fc3134139a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:24.467135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82461650-0858-4fbc-b590-80fc3134139a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:24.470727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9ca38-2fcb-4884-b17c-0c60267e9599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:24.471370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ca38-2fcb-4884-b17c-0c60267e9599 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:24.471840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ca38-2fcb-4884-b17c-0c60267e9599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:24.472151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ca38-2fcb-4884-b17c-0c60267e9599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:24.482796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9ca38-2fcb-4884-b17c-0c60267e9599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:24.484276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9ca38-2fcb-4884-b17c-0c60267e9599 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:24.494263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 728/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:26.954119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1dc02-7e2a-4a32-9573-ca81190b188a None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:26.954666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1dc02-7e2a-4a32-9573-ca81190b188a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:26.954666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1dc02-7e2a-4a32-9573-ca81190b188a None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:26.958158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:26.962004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6f588-f3f9-4bc6-9eaf-20d04f1db2d1 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:26.962404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6f588-f3f9-4bc6-9eaf-20d04f1db2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:26.962584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6f588-f3f9-4bc6-9eaf-20d04f1db2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:26.991471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-79f6f588-f3f9-4bc6-9eaf-20d04f1db2d1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:26.992742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-79f6f588-f3f9-4bc6-9eaf-20d04f1db2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:27.000987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:27.041010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1dc02-7e2a-4a32-9573-ca81190b188a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:27.054277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1dc02-7e2a-4a32-9573-ca81190b188a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:27.058762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bfafe-f143-4b83-8173-e165b1d4cb44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:27.059422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bfafe-f143-4b83-8173-e165b1d4cb44 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:27.059705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bfafe-f143-4b83-8173-e165b1d4cb44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:27.059979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bfafe-f143-4b83-8173-e165b1d4cb44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:27.069792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bfafe-f143-4b83-8173-e165b1d4cb44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:27.071221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bfafe-f143-4b83-8173-e165b1d4cb44 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:27.083138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 717/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:32:29.746201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b1ed-ef04-42ab-8bae-753bdab5af3b None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:29.746858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b1ed-ef04-42ab-8bae-753bdab5af3b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:29.746858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b1ed-ef04-42ab-8bae-753bdab5af3b None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:29.748149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:29.753954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74018da-218e-4afe-85be-5d7eb4b3aa4e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:29.754549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74018da-218e-4afe-85be-5d7eb4b3aa4e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:29.754549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74018da-218e-4afe-85be-5d7eb4b3aa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:29.772448 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c74018da-218e-4afe-85be-5d7eb4b3aa4e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:29.773650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c74018da-218e-4afe-85be-5d7eb4b3aa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:29.782259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:32:29.823488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6b1ed-ef04-42ab-8bae-753bdab5af3b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:29.834658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6b1ed-ef04-42ab-8bae-753bdab5af3b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:29.841472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ec5df-939f-4505-beeb-f34a9f593f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:29.841472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ec5df-939f-4505-beeb-f34a9f593f9a service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:29.841472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ec5df-939f-4505-beeb-f34a9f593f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:29.841472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ec5df-939f-4505-beeb-f34a9f593f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:29.851008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ec5df-939f-4505-beeb-f34a9f593f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:29.852970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ec5df-939f-4505-beeb-f34a9f593f9a service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:29.863445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 731/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:32.247142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b14d57-b02f-4b73-b6dd-7e19b56fd03f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:32.247658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b14d57-b02f-4b73-b6dd-7e19b56fd03f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:32.247658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b14d57-b02f-4b73-b6dd-7e19b56fd03f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:32.248988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:32.254432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315bb32-ba6f-433b-8bd4-64d6a43e0a13 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:32.254864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315bb32-ba6f-433b-8bd4-64d6a43e0a13 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:32.254989 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315bb32-ba6f-433b-8bd4-64d6a43e0a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:32.272950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a315bb32-ba6f-433b-8bd4-64d6a43e0a13 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:32.274155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a315bb32-ba6f-433b-8bd4-64d6a43e0a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:32.282357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:32.321992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b14d57-b02f-4b73-b6dd-7e19b56fd03f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:32.333319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b14d57-b02f-4b73-b6dd-7e19b56fd03f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:32.336889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0968dc-1f00-45ba-b472-57406b25dc66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:32.337700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0968dc-1f00-45ba-b472-57406b25dc66 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:32.338016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0968dc-1f00-45ba-b472-57406b25dc66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:32.338466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0968dc-1f00-45ba-b472-57406b25dc66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:32.348167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0968dc-1f00-45ba-b472-57406b25dc66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:32.349857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0968dc-1f00-45ba-b472-57406b25dc66 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:32.360380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 720/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:34.612379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8a8e-2b9d-4883-86bb-2ba157e8eded None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:34.612923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8a8e-2b9d-4883-86bb-2ba157e8eded None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:34.612923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c8a8e-2b9d-4883-86bb-2ba157e8eded None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:34.614299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:34.620018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2bdbc-720b-423c-ae3c-323104046906 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:34.620521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2bdbc-720b-423c-ae3c-323104046906 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:34.620667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2bdbc-720b-423c-ae3c-323104046906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:34.641012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fbc2bdbc-720b-423c-ae3c-323104046906 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:34.642231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fbc2bdbc-720b-423c-ae3c-323104046906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:34.650929 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:34.690125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c8a8e-2b9d-4883-86bb-2ba157e8eded None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:34.702315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c8a8e-2b9d-4883-86bb-2ba157e8eded None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:34.705919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cffe7-d4ed-48c8-b2e8-c014a7e52e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:34.706599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cffe7-d4ed-48c8-b2e8-c014a7e52e49 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:34.706881 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cffe7-d4ed-48c8-b2e8-c014a7e52e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:34.707156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cffe7-d4ed-48c8-b2e8-c014a7e52e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:34.717539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cffe7-d4ed-48c8-b2e8-c014a7e52e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:34.718979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cffe7-d4ed-48c8-b2e8-c014a7e52e49 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:34.729569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 734/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:36.989401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f132-7618-4e39-92e5-055bf2ea948f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:36.990031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f132-7618-4e39-92e5-055bf2ea948f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:36.990031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f132-7618-4e39-92e5-055bf2ea948f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:36.991300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:36.997170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fb4ea-950b-43bf-908a-f7067c015ba5 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:36.997693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fb4ea-950b-43bf-908a-f7067c015ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:36.997799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fb4ea-950b-43bf-908a-f7067c015ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:37.016216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-b07fb4ea-950b-43bf-908a-f7067c015ba5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:37.017431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b07fb4ea-950b-43bf-908a-f7067c015ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:37.026331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:37.064782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48f132-7618-4e39-92e5-055bf2ea948f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:37.076529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48f132-7618-4e39-92e5-055bf2ea948f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:37.080327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e437c8-7c7d-4745-b1d0-472c6e4779c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:37.081190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e437c8-7c7d-4745-b1d0-472c6e4779c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:37.081560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e437c8-7c7d-4745-b1d0-472c6e4779c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:37.081836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e437c8-7c7d-4745-b1d0-472c6e4779c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:37.092869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e437c8-7c7d-4745-b1d0-472c6e4779c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:37.094306 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e437c8-7c7d-4745-b1d0-472c6e4779c9 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:37.105526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 723/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:39.394833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fc42e-8a65-446c-a3f3-a979220c6fba None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:39.395375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fc42e-8a65-446c-a3f3-a979220c6fba None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:39.395375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fc42e-8a65-446c-a3f3-a979220c6fba None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:39.396835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:39.403104 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1699a5-9247-4c3c-b25e-5ba1fe3711d9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:39.405163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1699a5-9247-4c3c-b25e-5ba1fe3711d9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:39.405163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1699a5-9247-4c3c-b25e-5ba1fe3711d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:39.410586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=70 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:39.424298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fe1699a5-9247-4c3c-b25e-5ba1fe3711d9 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:39.433663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fe1699a5-9247-4c3c-b25e-5ba1fe3711d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:39.434009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:39.472847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fc42e-8a65-446c-a3f3-a979220c6fba None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:39.478845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=73 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:39.484957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fc42e-8a65-446c-a3f3-a979220c6fba None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:39.488749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2de16-082c-4146-9c42-c9dd30aa10df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:39.489397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2de16-082c-4146-9c42-c9dd30aa10df service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:39.489682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2de16-082c-4146-9c42-c9dd30aa10df service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:39.489952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2de16-082c-4146-9c42-c9dd30aa10df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:39.507778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2de16-082c-4146-9c42-c9dd30aa10df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:39.519878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2de16-082c-4146-9c42-c9dd30aa10df service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:39.527703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 737/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:41.780137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee8d9a-7b66-45d9-9ff5-754562643d28 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:41.780700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee8d9a-7b66-45d9-9ff5-754562643d28 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:41.780700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee8d9a-7b66-45d9-9ff5-754562643d28 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:41.782051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:41.787240 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422e0d-4fb4-40d0-97a8-b874d90870e6 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:41.787681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422e0d-4fb4-40d0-97a8-b874d90870e6 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:41.787812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422e0d-4fb4-40d0-97a8-b874d90870e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:41.808244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3b422e0d-4fb4-40d0-97a8-b874d90870e6 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:41.811069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3b422e0d-4fb4-40d0-97a8-b874d90870e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:41.817431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:41.856255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee8d9a-7b66-45d9-9ff5-754562643d28 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:41.867162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee8d9a-7b66-45d9-9ff5-754562643d28 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:41.871611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5aa93-e4d9-4e32-a8e3-c4cee81cab77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:41.872294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5aa93-e4d9-4e32-a8e3-c4cee81cab77 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:41.872580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5aa93-e4d9-4e32-a8e3-c4cee81cab77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:41.872855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5aa93-e4d9-4e32-a8e3-c4cee81cab77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:41.882455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5aa93-e4d9-4e32-a8e3-c4cee81cab77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:41.884618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5aa93-e4d9-4e32-a8e3-c4cee81cab77 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:41.894603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 726/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:44.093863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff4f6b-0515-42b1-a2bb-84743d4b2ccd None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:44.094438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff4f6b-0515-42b1-a2bb-84743d4b2ccd None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:44.094438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff4f6b-0515-42b1-a2bb-84743d4b2ccd None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:44.095750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:32:44.101546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51f30-1688-4fba-87a8-19e7c8f02da8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:44.102021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51f30-1688-4fba-87a8-19e7c8f02da8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:44.102115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51f30-1688-4fba-87a8-19e7c8f02da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:44.121318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9ed51f30-1688-4fba-87a8-19e7c8f02da8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:44.122568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9ed51f30-1688-4fba-87a8-19e7c8f02da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:44.130672 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:32:44.168542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff4f6b-0515-42b1-a2bb-84743d4b2ccd None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:44.184434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff4f6b-0515-42b1-a2bb-84743d4b2ccd None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:44.187999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59e293-7509-4087-83c5-4236a12421a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:44.188695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59e293-7509-4087-83c5-4236a12421a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:44.188982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59e293-7509-4087-83c5-4236a12421a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:44.189262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59e293-7509-4087-83c5-4236a12421a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:44.198962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59e293-7509-4087-83c5-4236a12421a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:44.200447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59e293-7509-4087-83c5-4236a12421a5 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:44.210523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 740/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:46.417524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecaecd-0622-4311-bd7b-b954a3c6068f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:46.418038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecaecd-0622-4311-bd7b-b954a3c6068f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:46.418038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecaecd-0622-4311-bd7b-b954a3c6068f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:46.419427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:32:46.425648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fd9ac-5759-4d0e-886c-dfa0031f6692 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:46.426171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fd9ac-5759-4d0e-886c-dfa0031f6692 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:46.426272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fd9ac-5759-4d0e-886c-dfa0031f6692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:46.448017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6b5fd9ac-5759-4d0e-886c-dfa0031f6692 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:32:46.449408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6b5fd9ac-5759-4d0e-886c-dfa0031f6692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:32:46.457452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:32:46.500642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecaecd-0622-4311-bd7b-b954a3c6068f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:32:46.512190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecaecd-0622-4311-bd7b-b954a3c6068f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:32:46.515932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7235-11b6-4c17-a288-4ff3e34c92a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:32:46.516617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7235-11b6-4c17-a288-4ff3e34c92a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:32:46.516903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7235-11b6-4c17-a288-4ff3e34c92a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:32:46.517176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7235-11b6-4c17-a288-4ff3e34c92a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:32:46.527849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7235-11b6-4c17-a288-4ff3e34c92a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:32:46.529332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7235-11b6-4c17-a288-4ff3e34c92a4 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:32:46.539540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 729/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:32:56.441835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=17 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:56.534998 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=17 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:07.755948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d25388-b316-48e9-8a5c-eaa6d55a5a9b None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:07.756586 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d25388-b316-48e9-8a5c-eaa6d55a5a9b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:07.756586 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d25388-b316-48e9-8a5c-eaa6d55a5a9b None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:07.758073 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 742/1471] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:33:07.764208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba3c3-93d4-497d-b0e9-8a58735451da None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:07.764762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba3c3-93d4-497d-b0e9-8a58735451da None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:07.764762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba3c3-93d4-497d-b0e9-8a58735451da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:07.783906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e36ba3c3-93d4-497d-b0e9-8a58735451da None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:33:07.785289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e36ba3c3-93d4-497d-b0e9-8a58735451da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:07.794289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 730/1472] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:33:07.844699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31abb8-d483-44d1-aaef-8aa2083fc3cf None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:07.844970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31abb8-d483-44d1-aaef-8aa2083fc3cf None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:07.845303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31abb8-d483-44d1-aaef-8aa2083fc3cf None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:07.846739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 743/1473] 10.222.0.77 () {54 vars in 962 bytes} [Thu Jun 16 17:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:33:07.853747 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45901f0-05f4-4d3f-81cd-49754dacfbb7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:07.854095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45901f0-05f4-4d3f-81cd-49754dacfbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:07.854414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45901f0-05f4-4d3f-81cd-49754dacfbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:07.877621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e45901f0-05f4-4d3f-81cd-49754dacfbb7 None None] MFA Rules not processed for user `dff915d0b23d4b9ebd70e6b6b885aca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:33:07.878899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e45901f0-05f4-4d3f-81cd-49754dacfbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:07.886195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 731/1474] 10.222.0.77 () {58 vars in 1059 bytes} [Thu Jun 16 17:33:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:33:07.894276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31abb8-d483-44d1-aaef-8aa2083fc3cf None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:33:07.907111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31abb8-d483-44d1-aaef-8aa2083fc3cf None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:33:07.911227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed17a3-a2f6-4835-88b0-8a0912cf2125 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff915d0b23d4b9ebd70e6b6b885aca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:33:07.911991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed17a3-a2f6-4835-88b0-8a0912cf2125 service glance] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:07.912391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed17a3-a2f6-4835-88b0-8a0912cf2125 service glance] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:07.912706 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed17a3-a2f6-4835-88b0-8a0912cf2125 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:07.925595 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed17a3-a2f6-4835-88b0-8a0912cf2125 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:33:07.927108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed17a3-a2f6-4835-88b0-8a0912cf2125 service glance] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:33:07.936931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 744/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:33:10.249264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065db7d-7a65-42e9-bef9-1e68bd832503 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:10.249805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065db7d-7a65-42e9-bef9-1e68bd832503 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:10.250115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065db7d-7a65-42e9-bef9-1e68bd832503 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:10.253693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 732/1476] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:33:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:33:10.258618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64cec-0df7-42ea-bd53-8f29f462ce43 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:10.259127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64cec-0df7-42ea-bd53-8f29f462ce43 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:10.259255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64cec-0df7-42ea-bd53-8f29f462ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:10.277884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-e0e64cec-0df7-42ea-bd53-8f29f462ce43 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:33:10.279083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e0e64cec-0df7-42ea-bd53-8f29f462ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:10.287067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 745/1477] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:33:10.311767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065db7d-7a65-42e9-bef9-1e68bd832503 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:33:10.326658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065db7d-7a65-42e9-bef9-1e68bd832503 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:33:10.331238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666406a-296e-48cb-8df3-982e8f31355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:33:10.331948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666406a-296e-48cb-8df3-982e8f31355a admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:10.332287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666406a-296e-48cb-8df3-982e8f31355a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:10.332590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666406a-296e-48cb-8df3-982e8f31355a admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:10.333374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666406a-296e-48cb-8df3-982e8f31355a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:33:10.335187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: WARNING py.warnings [None req-8666406a-296e-48cb-8df3-982e8f31355a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:33:10.335187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: warnings.warn(msg) Jun 16 17:33:10.335187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: Jun 16 17:33:10.337186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666406a-296e-48cb-8df3-982e8f31355a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:33:10.357446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 733/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Thu Jun 16 17:33:10 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:33:12.613425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3a59f-bdd7-4637-b593-f685b6994953 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:12.613983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3a59f-bdd7-4637-b593-f685b6994953 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:12.613983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3a59f-bdd7-4637-b593-f685b6994953 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:12.615357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 746/1479] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:33:12.621296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640165f-622e-4858-9569-8b8314c553b3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:12.621767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640165f-622e-4858-9569-8b8314c553b3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:12.621873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640165f-622e-4858-9569-8b8314c553b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:12.642362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1640165f-622e-4858-9569-8b8314c553b3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:33:12.643634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1640165f-622e-4858-9569-8b8314c553b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:12.652252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 734/1480] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:33:12.699523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3a59f-bdd7-4637-b593-f685b6994953 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:33:12.713804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3a59f-bdd7-4637-b593-f685b6994953 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:33:12.721344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbc70d-c883-40c2-8ebe-31e429c13c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:33:12.721344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbc70d-c883-40c2-8ebe-31e429c13c88 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:12.721344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbc70d-c883-40c2-8ebe-31e429c13c88 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:12.721344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbc70d-c883-40c2-8ebe-31e429c13c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:12.730621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbc70d-c883-40c2-8ebe-31e429c13c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:33:12.732290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbc70d-c883-40c2-8ebe-31e429c13c88 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:33:12.743346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 747/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:33:15.147185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6a55-7866-4fab-9093-3411a2f8876f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:15.147829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6a55-7866-4fab-9093-3411a2f8876f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:15.148497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6a55-7866-4fab-9093-3411a2f8876f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:15.149982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 735/1482] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:33:15.155540 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf344952-6c30-477d-b030-dd3be7e3c9ea None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:15.157048 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf344952-6c30-477d-b030-dd3be7e3c9ea None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:15.157048 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf344952-6c30-477d-b030-dd3be7e3c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:15.174220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-bf344952-6c30-477d-b030-dd3be7e3c9ea None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:33:15.175440 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-bf344952-6c30-477d-b030-dd3be7e3c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:15.183931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 748/1483] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:33:15.220946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6a55-7866-4fab-9093-3411a2f8876f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:33:15.232565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6a55-7866-4fab-9093-3411a2f8876f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:33:15.236325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d1b88-a4c4-4c05-a3bc-be7908acc9ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:33:15.236978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1b88-a4c4-4c05-a3bc-be7908acc9ed service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:15.237261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1b88-a4c4-4c05-a3bc-be7908acc9ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:15.237535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1b88-a4c4-4c05-a3bc-be7908acc9ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:15.247638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d1b88-a4c4-4c05-a3bc-be7908acc9ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:33:15.249094 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d1b88-a4c4-4c05-a3bc-be7908acc9ed service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:33:15.259686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 736/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:33:17.503438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa1c6-37d9-4d76-9bbd-bfff6306fc9a None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:17.504028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa1c6-37d9-4d76-9bbd-bfff6306fc9a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:17.504028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa1c6-37d9-4d76-9bbd-bfff6306fc9a None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:17.505379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 749/1485] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:33:17.511501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a74a45-aee4-491a-8b08-077006ede0a1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:17.511970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a74a45-aee4-491a-8b08-077006ede0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:17.512093 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a74a45-aee4-491a-8b08-077006ede0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:17.529931 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-63a74a45-aee4-491a-8b08-077006ede0a1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:33:17.531149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-63a74a45-aee4-491a-8b08-077006ede0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:17.539353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 737/1486] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:33:17.578556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffa1c6-37d9-4d76-9bbd-bfff6306fc9a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:33:17.589519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffa1c6-37d9-4d76-9bbd-bfff6306fc9a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:33:17.593292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977a663-06e5-4b7c-b42e-0a63abd89d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:33:17.593938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977a663-06e5-4b7c-b42e-0a63abd89d69 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:17.594226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977a663-06e5-4b7c-b42e-0a63abd89d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:17.594505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977a663-06e5-4b7c-b42e-0a63abd89d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:17.604488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977a663-06e5-4b7c-b42e-0a63abd89d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:33:17.605933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977a663-06e5-4b7c-b42e-0a63abd89d69 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:33:17.617621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 750/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:33:20.062904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7483a0-3e1a-4449-890c-a77cdf643b6a None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:20.063515 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7483a0-3e1a-4449-890c-a77cdf643b6a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:20.063515 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7483a0-3e1a-4449-890c-a77cdf643b6a None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:20.064851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 738/1488] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:33:20.071194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f0bc-82d4-4e68-815a-783df86e3dbd None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:20.071730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f0bc-82d4-4e68-815a-783df86e3dbd None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:20.071833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f0bc-82d4-4e68-815a-783df86e3dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:20.090654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-1aa9f0bc-82d4-4e68-815a-783df86e3dbd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:33:20.091872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-1aa9f0bc-82d4-4e68-815a-783df86e3dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:20.100272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 751/1489] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:33:20.141967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7483a0-3e1a-4449-890c-a77cdf643b6a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:33:20.153792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7483a0-3e1a-4449-890c-a77cdf643b6a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:33:20.157723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfc7a2-e177-4143-ad83-17e8736ffd34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:33:20.158396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfc7a2-e177-4143-ad83-17e8736ffd34 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:20.158679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfc7a2-e177-4143-ad83-17e8736ffd34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:20.158987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfc7a2-e177-4143-ad83-17e8736ffd34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:20.168951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfc7a2-e177-4143-ad83-17e8736ffd34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:33:20.170405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfc7a2-e177-4143-ad83-17e8736ffd34 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:33:20.181043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 739/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:33:22.783996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47e6f-35bb-4e17-ad61-9f28224cef93 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:22.784594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47e6f-35bb-4e17-ad61-9f28224cef93 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:22.784594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47e6f-35bb-4e17-ad61-9f28224cef93 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:22.785951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 752/1491] 10.222.0.77 () {54 vars in 926 bytes} [Thu Jun 16 17:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:33:22.791426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515e13d-1977-4a03-b59a-53f579707285 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:22.791931 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515e13d-1977-4a03-b59a-53f579707285 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:22.792042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515e13d-1977-4a03-b59a-53f579707285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:22.814168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e515e13d-1977-4a03-b59a-53f579707285 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:33:22.815372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e515e13d-1977-4a03-b59a-53f579707285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:33:22.823734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 740/1492] 10.222.0.77 () {58 vars in 1023 bytes} [Thu Jun 16 17:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:33:22.863805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47e6f-35bb-4e17-ad61-9f28224cef93 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:33:22.875562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47e6f-35bb-4e17-ad61-9f28224cef93 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:33:22.879119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716f6c2-2cb9-43dd-b0a8-28252b82e65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:33:22.879769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f6c2-2cb9-43dd-b0a8-28252b82e65c service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:33:22.880051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f6c2-2cb9-43dd-b0a8-28252b82e65c service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:33:22.880357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f6c2-2cb9-43dd-b0a8-28252b82e65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:33:22.891352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716f6c2-2cb9-43dd-b0a8-28252b82e65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:33:22.892875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716f6c2-2cb9-43dd-b0a8-28252b82e65c service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:33:22.905212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 753/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:33:32.809044 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=33 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:33:32.898772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=33 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:18.156015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a198fc-3283-498a-ac7d-feee56693d1a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.156673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a198fc-3283-498a-ac7d-feee56693d1a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.156673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a198fc-3283-498a-ac7d-feee56693d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:18.176382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f8a198fc-3283-498a-ac7d-feee56693d1a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:35:18.177588 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f8a198fc-3283-498a-ac7d-feee56693d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:18.186128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 741/1494] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:35:18.195682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502415b5-1906-4505-8e50-d01f27f94fee None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.196269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502415b5-1906-4505-8e50-d01f27f94fee None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.196269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502415b5-1906-4505-8e50-d01f27f94fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:18.215631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-502415b5-1906-4505-8e50-d01f27f94fee None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:35:18.217134 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-502415b5-1906-4505-8e50-d01f27f94fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:18.225173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 754/1495] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:35:18.230872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a198fc-3283-498a-ac7d-feee56693d1a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:18.240811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a198fc-3283-498a-ac7d-feee56693d1a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:18.245586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee94c8-2262-4c01-a43b-c9abea2a4e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:18.246252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee94c8-2262-4c01-a43b-c9abea2a4e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.246537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee94c8-2262-4c01-a43b-c9abea2a4e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.246813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee94c8-2262-4c01-a43b-c9abea2a4e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:18.247543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee94c8-2262-4c01-a43b-c9abea2a4e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:35:18.247836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee94c8-2262-4c01-a43b-c9abea2a4e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:18.248976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: WARNING py.warnings [None req-84ee94c8-2262-4c01-a43b-c9abea2a4e39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:35:18.248976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: warnings.warn(msg) Jun 16 17:35:18.248976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: Jun 16 17:35:18.250007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee94c8-2262-4c01-a43b-c9abea2a4e39 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:18.263560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 742/1496] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:35:18.271708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502415b5-1906-4505-8e50-d01f27f94fee None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:18.281841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502415b5-1906-4505-8e50-d01f27f94fee None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:18.286505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b063ff9-d8ab-439a-8423-0755a431ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:18.287177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b063ff9-d8ab-439a-8423-0755a431ff6b admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.287461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b063ff9-d8ab-439a-8423-0755a431ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.287737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b063ff9-d8ab-439a-8423-0755a431ff6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:18.289178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b063ff9-d8ab-439a-8423-0755a431ff6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:18.291021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: WARNING py.warnings [None req-3b063ff9-d8ab-439a-8423-0755a431ff6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:35:18.291021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: warnings.warn(msg) Jun 16 17:35:18.291021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: Jun 16 17:35:18.292247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b063ff9-d8ab-439a-8423-0755a431ff6b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:18.391441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 755/1497] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:35:18 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:35:18.395956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee94c8-2262-4c01-a43b-c9abea2a4e39 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:18.407459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee94c8-2262-4c01-a43b-c9abea2a4e39 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:18.470274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8eefa-ded8-4333-b5bf-63bc5b8f7cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:18.471028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8eefa-ded8-4333-b5bf-63bc5b8f7cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.471312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8eefa-ded8-4333-b5bf-63bc5b8f7cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.471622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8eefa-ded8-4333-b5bf-63bc5b8f7cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:18.472391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8eefa-ded8-4333-b5bf-63bc5b8f7cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:18.473485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: WARNING py.warnings [None req-39c8eefa-ded8-4333-b5bf-63bc5b8f7cb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:35:18.473485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: warnings.warn(msg) Jun 16 17:35:18.473485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: Jun 16 17:35:18.474769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8eefa-ded8-4333-b5bf-63bc5b8f7cb6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:18.635805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 743/1498] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:35:18 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:35:18.640050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b063ff9-d8ab-439a-8423-0755a431ff6b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:18.650930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b063ff9-d8ab-439a-8423-0755a431ff6b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:18.655462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f9d60-f299-4a21-af1a-4e962caaae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:18.656151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f9d60-f299-4a21-af1a-4e962caaae4e admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.656437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f9d60-f299-4a21-af1a-4e962caaae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.656715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f9d60-f299-4a21-af1a-4e962caaae4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:18.657433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f9d60-f299-4a21-af1a-4e962caaae4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:18.658587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: WARNING py.warnings [None req-9b9f9d60-f299-4a21-af1a-4e962caaae4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:35:18.658587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: warnings.warn(msg) Jun 16 17:35:18.658587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: Jun 16 17:35:18.659409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f9d60-f299-4a21-af1a-4e962caaae4e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:18.673302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 756/1499] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:35:18.677952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8eefa-ded8-4333-b5bf-63bc5b8f7cb6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:18.688807 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8eefa-ded8-4333-b5bf-63bc5b8f7cb6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:18.693688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84801df-e34c-4e9d-82a3-cbacb69fd67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:18.694362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84801df-e34c-4e9d-82a3-cbacb69fd67d admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.695159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84801df-e34c-4e9d-82a3-cbacb69fd67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.695440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84801df-e34c-4e9d-82a3-cbacb69fd67d admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:18.696244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84801df-e34c-4e9d-82a3-cbacb69fd67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:18.697267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: WARNING py.warnings [None req-e84801df-e34c-4e9d-82a3-cbacb69fd67d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:35:18.697267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: warnings.warn(msg) Jun 16 17:35:18.697267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: Jun 16 17:35:18.698189 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84801df-e34c-4e9d-82a3-cbacb69fd67d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:18.712840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 744/1500] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:35:18.717372 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f9d60-f299-4a21-af1a-4e962caaae4e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:18.727605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f9d60-f299-4a21-af1a-4e962caaae4e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:18.732333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4da9d-1387-4396-818c-250f8fd3bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:18.733202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4da9d-1387-4396-818c-250f8fd3bcac admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.733486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4da9d-1387-4396-818c-250f8fd3bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.733762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4da9d-1387-4396-818c-250f8fd3bcac admin admin] PATH_INFO: `/v3/projects/c45c2fe86e67447587b5efff2a4a250e/users/3268f19a02ea42d0af8f33b3cc7474d1/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:18.750295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4da9d-1387-4396-818c-250f8fd3bcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45c2fe86e67447587b5efff2a4a250e, user_id=3268f19a02ea42d0af8f33b3cc7474d1, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:18.751360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: WARNING py.warnings [None req-d3f4da9d-1387-4396-818c-250f8fd3bcac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:35:18.751360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: warnings.warn(msg) Jun 16 17:35:18.751360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: Jun 16 17:35:18.753301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4da9d-1387-4396-818c-250f8fd3bcac admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:18.846814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 757/1501] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:35:18 2022] PUT /identity/v3/projects/c45c2fe86e67447587b5efff2a4a250e/users/3268f19a02ea42d0af8f33b3cc7474d1/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:35:18.858385 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed789f59-2326-4746-8177-80cabc0d1fc7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.858672 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed789f59-2326-4746-8177-80cabc0d1fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.858948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed789f59-2326-4746-8177-80cabc0d1fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:18.890206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ed789f59-2326-4746-8177-80cabc0d1fc7 None None] MFA Rules not processed for user `3268f19a02ea42d0af8f33b3cc7474d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:35:18.891449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ed789f59-2326-4746-8177-80cabc0d1fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:18.965350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 745/1502] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:35:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:35:18.979540 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228b992-113e-4969-93a4-62c774a74ae7 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.979829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228b992-113e-4969-93a4-62c774a74ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.980134 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228b992-113e-4969-93a4-62c774a74ae7 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:18.981857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 758/1503] 10.222.0.77 () {54 vars in 963 bytes} [Thu Jun 16 17:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:35:18.987729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02234e85-3087-4ce4-82c8-6a2593da060b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:18.988019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02234e85-3087-4ce4-82c8-6a2593da060b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:18.989189 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02234e85-3087-4ce4-82c8-6a2593da060b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:19.012740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-02234e85-3087-4ce4-82c8-6a2593da060b None None] MFA Rules not processed for user `adf46b0ab3b9400d8fc44ba3a1574f27`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:35:19.013956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-02234e85-3087-4ce4-82c8-6a2593da060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:19.059398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:19.067371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 746/1504] 10.222.0.77 () {58 vars in 1060 bytes} [Thu Jun 16 17:35:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:35:19.075934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228b992-113e-4969-93a4-62c774a74ae7 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:19.088414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228b992-113e-4969-93a4-62c774a74ae7 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:19.092484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb8d01-d46b-4ec1-bcb3-82827b3b0477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:19.093510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8d01-d46b-4ec1-bcb3-82827b3b0477 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:19.093510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8d01-d46b-4ec1-bcb3-82827b3b0477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:19.093796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8d01-d46b-4ec1-bcb3-82827b3b0477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:19.102471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb8d01-d46b-4ec1-bcb3-82827b3b0477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:19.103894 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb8d01-d46b-4ec1-bcb3-82827b3b0477 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:19.113679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 759/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:35:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:35:19.160337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9f43-99b0-4159-9d59-d1dc57cd9fb8 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:19.160776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9f43-99b0-4159-9d59-d1dc57cd9fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:19.160916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9f43-99b0-4159-9d59-d1dc57cd9fb8 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:19.162245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 747/1506] 10.222.0.77 () {52 vars in 829 bytes} [Thu Jun 16 17:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:35:19.166944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb8d01-d46b-4ec1-bcb3-82827b3b0477 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:19.233189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb8d01-d46b-4ec1-bcb3-82827b3b0477 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:19.237800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:19.238692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:19.238980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:19.239263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] PATH_INFO: `/v3/users/3268f19a02ea42d0af8f33b3cc7474d1` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:19.240905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3268f19a02ea42d0af8f33b3cc7474d1)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:19.242421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: WARNING py.warnings [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:35:19.242421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: warnings.warn(msg) Jun 16 17:35:19.242421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: Jun 16 17:35:19.243642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:19.472818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3268f19a02ea42d0af8f33b3cc7474d1'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:19.494421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3268f19a02ea42d0af8f33b3cc7474d1'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:19.571429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3268f19a02ea42d0af8f33b3cc7474d1'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:19.572105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3268f19a02ea42d0af8f33b3cc7474d1'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:19.572841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3268f19a02ea42d0af8f33b3cc7474d1'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:19.584777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:19.595895 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 760/1507] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:35:19 2022] DELETE /identity/v3/users/3268f19a02ea42d0af8f33b3cc7474d1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:35:19.600671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71401-2b53-46df-9ea4-634bb8b2d260 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:19.602040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71401-2b53-46df-9ea4-634bb8b2d260 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:19.602415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71401-2b53-46df-9ea4-634bb8b2d260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:19.621192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-40a71401-2b53-46df-9ea4-634bb8b2d260 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:35:19.622455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-40a71401-2b53-46df-9ea4-634bb8b2d260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:19.688370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 748/1508] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:35:19.697928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:19.699420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:19.758628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0228f1-262b-4c81-85d2-a4b1a6f08a03 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:19.762273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717abc4-dd0d-4c2e-8a56-07c45c22c215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:19.763004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717abc4-dd0d-4c2e-8a56-07c45c22c215 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:19.763347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717abc4-dd0d-4c2e-8a56-07c45c22c215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:19.763634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717abc4-dd0d-4c2e-8a56-07c45c22c215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:19.773915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717abc4-dd0d-4c2e-8a56-07c45c22c215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:19.775343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717abc4-dd0d-4c2e-8a56-07c45c22c215 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:19.785174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 761/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:35:20.278997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a71401-2b53-46df-9ea4-634bb8b2d260 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:35:20.281123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-40a71401-2b53-46df-9ea4-634bb8b2d260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:35:20.293040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a71401-2b53-46df-9ea4-634bb8b2d260 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:35:20.297693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:35:20.298567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:35:20.298850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:35:20.299128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] PATH_INFO: `/v3/projects/c45c2fe86e67447587b5efff2a4a250e` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:35:20.300360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45c2fe86e67447587b5efff2a4a250e)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:35:20.301382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: WARNING py.warnings [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:35:20.301382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: warnings.warn(msg) Jun 16 17:35:20.301382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: Jun 16 17:35:20.302577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:35:20.423107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45c2fe86e67447587b5efff2a4a250e', 'request_id': 'req-57cb818d-b4f2-4a2f-82b0-85d299e159e8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:20.430222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45c2fe86e67447587b5efff2a4a250e', 'request_id': 'req-57cb818d-b4f2-4a2f-82b0-85d299e159e8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:20.502874 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45c2fe86e67447587b5efff2a4a250e', 'request_id': 'req-57cb818d-b4f2-4a2f-82b0-85d299e159e8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:20.523282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] The token cache is being invalidate because project c45c2fe86e67447587b5efff2a4a250e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:35:20.523656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:20.524617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-57cb818d-b4f2-4a2f-82b0-85d299e159e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:35:20.526217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 749/1510] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:35:20 2022] DELETE /identity/v3/projects/c45c2fe86e67447587b5efff2a4a250e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:35:29.780753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=29 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:30.520120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:12.377743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dd12e-1719-41fb-b9d1-f648f6c8dbc7 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:12.378354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dd12e-1719-41fb-b9d1-f648f6c8dbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:12.378354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dd12e-1719-41fb-b9d1-f648f6c8dbc7 None None] PATH_INFO: `/v3` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:12.379827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 762/1511] 10.222.0.87 () {54 vars in 925 bytes} [Thu Jun 16 17:37:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:37:12.386546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1007e-5f63-4be4-9856-3dd25e875e7e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:12.387055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1007e-5f63-4be4-9856-3dd25e875e7e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:12.387155 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1007e-5f63-4be4-9856-3dd25e875e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:12.407559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a5f1007e-5f63-4be4-9856-3dd25e875e7e None None] MFA Rules not processed for user `a2909d4015ac45fcaf6d1fc8e488aa44`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:12.408739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a5f1007e-5f63-4be4-9856-3dd25e875e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:12.482809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 750/1512] 10.222.0.87 () {58 vars in 1015 bytes} [Thu Jun 16 17:37:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:37:13.253838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da011d9b-1090-4add-8d76-265f5f71672e None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:13.254256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da011d9b-1090-4add-8d76-265f5f71672e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:13.254654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da011d9b-1090-4add-8d76-265f5f71672e None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:13.256206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 763/1513] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:37:13.263250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d9f29-64be-4d37-8ebf-3417441477e6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:13.263541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d9f29-64be-4d37-8ebf-3417441477e6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:13.263824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d9f29-64be-4d37-8ebf-3417441477e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:13.282437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-112d9f29-64be-4d37-8ebf-3417441477e6 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:13.283575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-112d9f29-64be-4d37-8ebf-3417441477e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:13.349160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 751/1514] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:37:13.530947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da011d9b-1090-4add-8d76-265f5f71672e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:13.541855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-da011d9b-1090-4add-8d76-265f5f71672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:13.610059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da011d9b-1090-4add-8d76-265f5f71672e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:13.615541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72fc6-abab-488f-9eb7-fd391643bb96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:13.616236 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72fc6-abab-488f-9eb7-fd391643bb96 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:13.616521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72fc6-abab-488f-9eb7-fd391643bb96 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:13.616798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72fc6-abab-488f-9eb7-fd391643bb96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:13.625817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf72fc6-abab-488f-9eb7-fd391643bb96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:13.627462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf72fc6-abab-488f-9eb7-fd391643bb96 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:13.638955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 764/1515] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:14.590678 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0c393-a724-493d-a98a-1ae0f686eab7 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:14.591246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0c393-a724-493d-a98a-1ae0f686eab7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:14.591246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0c393-a724-493d-a98a-1ae0f686eab7 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:14.592663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 752/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:37:14.597783 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba355-cabc-4680-bb9f-7242b1daf4d8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:14.598220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba355-cabc-4680-bb9f-7242b1daf4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:14.598337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ba355-cabc-4680-bb9f-7242b1daf4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:14.618151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-854ba355-cabc-4680-bb9f-7242b1daf4d8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:14.619374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-854ba355-cabc-4680-bb9f-7242b1daf4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:14.628660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 765/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:37:14.782634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0c393-a724-493d-a98a-1ae0f686eab7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:14.797727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0c393-a724-493d-a98a-1ae0f686eab7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:14.803219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9db73-9366-41e3-95b8-3617abc86bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:14.803865 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9db73-9366-41e3-95b8-3617abc86bd3 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:14.804180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9db73-9366-41e3-95b8-3617abc86bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:14.804520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9db73-9366-41e3-95b8-3617abc86bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:14.814918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9db73-9366-41e3-95b8-3617abc86bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:14.816556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9db73-9366-41e3-95b8-3617abc86bd3 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:14.826684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 753/1518] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:20.496963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70489e1a-2c3d-45dc-b741-178e1be2df3d None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:20.497622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70489e1a-2c3d-45dc-b741-178e1be2df3d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:20.497622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70489e1a-2c3d-45dc-b741-178e1be2df3d None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:20.498886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 766/1519] 10.222.0.77 () {54 vars in 960 bytes} [Thu Jun 16 17:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:37:20.504451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724258c-12c1-44ad-91b6-9b0be4c6b7f2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:20.504948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724258c-12c1-44ad-91b6-9b0be4c6b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:20.504948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724258c-12c1-44ad-91b6-9b0be4c6b7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:20.523161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3724258c-12c1-44ad-91b6-9b0be4c6b7f2 None None] MFA Rules not processed for user `a2909d4015ac45fcaf6d1fc8e488aa44`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:20.524622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3724258c-12c1-44ad-91b6-9b0be4c6b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:20.533047 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 754/1520] 10.222.0.77 () {58 vars in 1057 bytes} [Thu Jun 16 17:37:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:37:20.541605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70489e1a-2c3d-45dc-b741-178e1be2df3d None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:20.556237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70489e1a-2c3d-45dc-b741-178e1be2df3d None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:20.561354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbd716-afb6-4ace-b235-8812246e753f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:20.562011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbd716-afb6-4ace-b235-8812246e753f service placement] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:20.562297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbd716-afb6-4ace-b235-8812246e753f service placement] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:20.562572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbd716-afb6-4ace-b235-8812246e753f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:20.572437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbd716-afb6-4ace-b235-8812246e753f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:20.574029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbd716-afb6-4ace-b235-8812246e753f service placement] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:20.585074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 767/1521] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:37:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:26.173530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b61f2-f183-495a-af73-35ea9dcc79fb None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:26.174110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b61f2-f183-495a-af73-35ea9dcc79fb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:26.174110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b61f2-f183-495a-af73-35ea9dcc79fb None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:26.175470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:37:26.180600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425b9ff-9136-4ce5-a9b8-c1dcfdcaf98f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:26.181082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425b9ff-9136-4ce5-a9b8-c1dcfdcaf98f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:26.181212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425b9ff-9136-4ce5-a9b8-c1dcfdcaf98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:26.200489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-5425b9ff-9136-4ce5-a9b8-c1dcfdcaf98f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:26.201710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5425b9ff-9136-4ce5-a9b8-c1dcfdcaf98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:26.209949 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:37:26.371102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b61f2-f183-495a-af73-35ea9dcc79fb None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:26.388492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b61f2-f183-495a-af73-35ea9dcc79fb None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:26.393911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf17363-27f6-45a6-a5b5-8dd8ca55767a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:26.394563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17363-27f6-45a6-a5b5-8dd8ca55767a service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:26.394845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17363-27f6-45a6-a5b5-8dd8ca55767a service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:26.395119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf17363-27f6-45a6-a5b5-8dd8ca55767a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:26.406640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf17363-27f6-45a6-a5b5-8dd8ca55767a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:26.406640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf17363-27f6-45a6-a5b5-8dd8ca55767a service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:26.416648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 756/1524] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:27.311105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb3940-b07c-42fe-aa90-9becb5127710 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:27.311691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb3940-b07c-42fe-aa90-9becb5127710 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:27.311691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb3940-b07c-42fe-aa90-9becb5127710 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:27.313432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 17:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:37:27.318734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558bce8-eb4e-49fb-9980-94e87dede56d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:27.319302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558bce8-eb4e-49fb-9980-94e87dede56d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:27.319302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558bce8-eb4e-49fb-9980-94e87dede56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:27.340495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6558bce8-eb4e-49fb-9980-94e87dede56d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:27.341748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6558bce8-eb4e-49fb-9980-94e87dede56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:27.350070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 17:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:37:27.508219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb3940-b07c-42fe-aa90-9becb5127710 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:27.522755 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb3940-b07c-42fe-aa90-9becb5127710 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:27.528765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4137cdc-1830-4214-90d5-8f424167930f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:27.529425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4137cdc-1830-4214-90d5-8f424167930f service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:27.529708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4137cdc-1830-4214-90d5-8f424167930f service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:27.529983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4137cdc-1830-4214-90d5-8f424167930f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:27.538701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4137cdc-1830-4214-90d5-8f424167930f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:27.541001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4137cdc-1830-4214-90d5-8f424167930f service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:27.551130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 770/1527] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:31.616486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8d549-c39c-4a78-8580-25c089a7c5d6 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:31.617107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8d549-c39c-4a78-8580-25c089a7c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:31.617490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8d549-c39c-4a78-8580-25c089a7c5d6 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:31.619002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:37:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:37:31.624749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b766c-8b63-44d4-9bc8-e942e2776ec3 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:31.625218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b766c-8b63-44d4-9bc8-e942e2776ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:31.625365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b766c-8b63-44d4-9bc8-e942e2776ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:31.643962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-786b766c-8b63-44d4-9bc8-e942e2776ec3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:31.645113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-786b766c-8b63-44d4-9bc8-e942e2776ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:31.654121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:37:31.691787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8d549-c39c-4a78-8580-25c089a7c5d6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:31.693553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-efe8d549-c39c-4a78-8580-25c089a7c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:31.756178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8d549-c39c-4a78-8580-25c089a7c5d6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:31.760397 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609440d-29cc-4bfb-a0c8-1406e6bc928d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:31.761054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609440d-29cc-4bfb-a0c8-1406e6bc928d service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:31.761333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609440d-29cc-4bfb-a0c8-1406e6bc928d service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:31.761606 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609440d-29cc-4bfb-a0c8-1406e6bc928d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:31.770996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609440d-29cc-4bfb-a0c8-1406e6bc928d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:31.772465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609440d-29cc-4bfb-a0c8-1406e6bc928d service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:31.778225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:31.783042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 759/1530] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:33.966293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f3b37-2b08-4831-88c8-83e61e41a538 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:33.966869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f3b37-2b08-4831-88c8-83e61e41a538 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:33.966869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f3b37-2b08-4831-88c8-83e61e41a538 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:33.968491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:37:33.974157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859028d-076c-4909-9b48-8c82364360ad None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:33.974637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859028d-076c-4909-9b48-8c82364360ad None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:33.974792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859028d-076c-4909-9b48-8c82364360ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:33.994892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2859028d-076c-4909-9b48-8c82364360ad None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:33.996147 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2859028d-076c-4909-9b48-8c82364360ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:34.004505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:37:34.043485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f3b37-2b08-4831-88c8-83e61e41a538 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:34.054496 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f3b37-2b08-4831-88c8-83e61e41a538 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:34.058092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9e145-5465-4dcc-93f8-d4cef6219b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:34.058735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9e145-5465-4dcc-93f8-d4cef6219b0f service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:34.059020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9e145-5465-4dcc-93f8-d4cef6219b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:34.059294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9e145-5465-4dcc-93f8-d4cef6219b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:34.068783 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9e145-5465-4dcc-93f8-d4cef6219b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:34.071042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9e145-5465-4dcc-93f8-d4cef6219b0f service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:34.081253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 773/1533] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:38.045559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc98a3-e2e6-4010-ba36-cb4c3995911b None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:38.046335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc98a3-e2e6-4010-ba36-cb4c3995911b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:38.046335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc98a3-e2e6-4010-ba36-cb4c3995911b None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:38.047816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:37:38.053445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386782-f1ba-4220-b23f-7b3729e43149 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:38.053953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386782-f1ba-4220-b23f-7b3729e43149 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:38.054072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386782-f1ba-4220-b23f-7b3729e43149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:38.075258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9f386782-f1ba-4220-b23f-7b3729e43149 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:38.076544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9f386782-f1ba-4220-b23f-7b3729e43149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:38.084551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:37:38.356405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc98a3-e2e6-4010-ba36-cb4c3995911b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:38.358230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f1cc98a3-e2e6-4010-ba36-cb4c3995911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:38.421709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc98a3-e2e6-4010-ba36-cb4c3995911b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:38.425666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56826321-56ce-4695-8c30-a2be80778eeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:38.426324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826321-56ce-4695-8c30-a2be80778eeb service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:38.426608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826321-56ce-4695-8c30-a2be80778eeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:38.426887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826321-56ce-4695-8c30-a2be80778eeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:38.437303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56826321-56ce-4695-8c30-a2be80778eeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:38.438734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56826321-56ce-4695-8c30-a2be80778eeb service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:38.449276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 762/1536] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:40.666890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357b99-79b9-46e4-a44e-f3e485e70fc9 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:40.667456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357b99-79b9-46e4-a44e-f3e485e70fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:40.667456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357b99-79b9-46e4-a44e-f3e485e70fc9 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:40.668896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 17:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:37:40.674611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fd554-3ed9-4c4c-955e-4eb6be3cfce7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:40.675106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fd554-3ed9-4c4c-955e-4eb6be3cfce7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:40.675204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fd554-3ed9-4c4c-955e-4eb6be3cfce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:40.694565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-152fd554-3ed9-4c4c-955e-4eb6be3cfce7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:37:40.695510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-152fd554-3ed9-4c4c-955e-4eb6be3cfce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:40.703547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 17:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:37:40.971660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357b99-79b9-46e4-a44e-f3e485e70fc9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:37:40.973391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f6357b99-79b9-46e4-a44e-f3e485e70fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:37:40.982050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=65 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:40.987961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357b99-79b9-46e4-a44e-f3e485e70fc9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:37:40.991516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15c1e8-1a43-491b-aee2-c6a578b7604a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:37:40.992334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c1e8-1a43-491b-aee2-c6a578b7604a service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:37:40.992672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c1e8-1a43-491b-aee2-c6a578b7604a service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:37:40.992951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15c1e8-1a43-491b-aee2-c6a578b7604a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:37:41.012997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15c1e8-1a43-491b-aee2-c6a578b7604a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:37:41.012997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15c1e8-1a43-491b-aee2-c6a578b7604a service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:37:41.013771 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 776/1539] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:37:50.688590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=32 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:51.038269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:20.317871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a23d9-c8c7-4fd2-8635-4c1ae1865be0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.319837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a23d9-c8c7-4fd2-8635-4c1ae1865be0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.319837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a23d9-c8c7-4fd2-8635-4c1ae1865be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.342203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1a9a23d9-c8c7-4fd2-8635-4c1ae1865be0 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:20.343904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1a9a23d9-c8c7-4fd2-8635-4c1ae1865be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:20.355211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 764/1540] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:20.364889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c293537-8f97-4a9a-ba1e-43c7edd1435e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.366103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c293537-8f97-4a9a-ba1e-43c7edd1435e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.366697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c293537-8f97-4a9a-ba1e-43c7edd1435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.388992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4c293537-8f97-4a9a-ba1e-43c7edd1435e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:20.390563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4c293537-8f97-4a9a-ba1e-43c7edd1435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:20.410447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 777/1541] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:20.415143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a23d9-c8c7-4fd2-8635-4c1ae1865be0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:20.427441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a23d9-c8c7-4fd2-8635-4c1ae1865be0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:20.433221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4d315-56c2-4783-a873-ee8c467e515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:20.434166 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4d315-56c2-4783-a873-ee8c467e515c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.434673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4d315-56c2-4783-a873-ee8c467e515c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.435169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4d315-56c2-4783-a873-ee8c467e515c admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.436166 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4d315-56c2-4783-a873-ee8c467e515c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:20.436745 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4d315-56c2-4783-a873-ee8c467e515c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:20.438553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4d315-56c2-4783-a873-ee8c467e515c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:20.457679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 765/1542] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:20.466527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c293537-8f97-4a9a-ba1e-43c7edd1435e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:20.473670 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927253-1f51-479a-b616-e6bb74540475 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.473926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927253-1f51-479a-b616-e6bb74540475 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.474177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927253-1f51-479a-b616-e6bb74540475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.481632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c293537-8f97-4a9a-ba1e-43c7edd1435e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:20.491350 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5932c-bcaf-4a94-aa19-563de20d3fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:20.492578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5932c-bcaf-4a94-aa19-563de20d3fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.493089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5932c-bcaf-4a94-aa19-563de20d3fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.493786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5932c-bcaf-4a94-aa19-563de20d3fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.494880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5932c-bcaf-4a94-aa19-563de20d3fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:20.497075 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5932c-bcaf-4a94-aa19-563de20d3fb9 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:20.514739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3a927253-1f51-479a-b616-e6bb74540475 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:20.515963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3a927253-1f51-479a-b616-e6bb74540475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:20.533728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 766/1543] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 16 17:39:20.550900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab491e8b-9695-4967-aa08-49cfa62cf227 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.551269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab491e8b-9695-4967-aa08-49cfa62cf227 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.551466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab491e8b-9695-4967-aa08-49cfa62cf227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.586205 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ab491e8b-9695-4967-aa08-49cfa62cf227 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:20.588099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ab491e8b-9695-4967-aa08-49cfa62cf227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:20.601349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 767/1544] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:39:20.604335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 778/1545] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:20.607047 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab491e8b-9695-4967-aa08-49cfa62cf227 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:20.608537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5932c-bcaf-4a94-aa19-563de20d3fb9 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:20.622054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab491e8b-9695-4967-aa08-49cfa62cf227 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:20.736879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5932c-bcaf-4a94-aa19-563de20d3fb9 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:20.742560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe85969-c494-44bc-b7d1-b5b4e486a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:20.743592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe85969-c494-44bc-b7d1-b5b4e486a4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.744435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe85969-c494-44bc-b7d1-b5b4e486a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.744712 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe85969-c494-44bc-b7d1-b5b4e486a4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.745417 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe85969-c494-44bc-b7d1-b5b4e486a4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:20.746449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: WARNING py.warnings [None req-8fe85969-c494-44bc-b7d1-b5b4e486a4e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:39:20.746449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: warnings.warn(msg) Jun 16 17:39:20.746449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: Jun 16 17:39:20.747658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe85969-c494-44bc-b7d1-b5b4e486a4e0 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:20.780860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ad129-e76a-45d2-85fa-cc44e05051d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:20.781567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ad129-e76a-45d2-85fa-cc44e05051d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.781856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ad129-e76a-45d2-85fa-cc44e05051d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.782133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ad129-e76a-45d2-85fa-cc44e05051d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.783146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ad129-e76a-45d2-85fa-cc44e05051d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:20.783465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ad129-e76a-45d2-85fa-cc44e05051d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:20.785124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ad129-e76a-45d2-85fa-cc44e05051d7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:20.808562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 768/1546] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:20.817288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ad129-e76a-45d2-85fa-cc44e05051d7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:20.829783 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ad129-e76a-45d2-85fa-cc44e05051d7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:20.841662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292ef98-3434-4418-9c3d-f9143107c828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:20.842750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ef98-3434-4418-9c3d-f9143107c828 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.843259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ef98-3434-4418-9c3d-f9143107c828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.843754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ef98-3434-4418-9c3d-f9143107c828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.844795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292ef98-3434-4418-9c3d-f9143107c828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:20.846068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: WARNING py.warnings [None req-6292ef98-3434-4418-9c3d-f9143107c828 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:39:20.846068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: warnings.warn(msg) Jun 16 17:39:20.846068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: Jun 16 17:39:20.847869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292ef98-3434-4418-9c3d-f9143107c828 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:20.852335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 779/1547] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:39:20.854400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf798e-f85a-45c5-b185-13c904958abd None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.854593 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf798e-f85a-45c5-b185-13c904958abd None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.854931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf798e-f85a-45c5-b185-13c904958abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.886231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-51bf798e-f85a-45c5-b185-13c904958abd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:20.887853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-51bf798e-f85a-45c5-b185-13c904958abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:20.897514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 780/1548] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:39:20.899183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263e7be-fb3d-4863-8694-13955f664445 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.899558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263e7be-fb3d-4863-8694-13955f664445 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.900696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263e7be-fb3d-4863-8694-13955f664445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.922889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-5263e7be-fb3d-4863-8694-13955f664445 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:20.924267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5263e7be-fb3d-4863-8694-13955f664445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:20.933998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 781/1549] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:20.934984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263e7be-fb3d-4863-8694-13955f664445 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:20.949010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263e7be-fb3d-4863-8694-13955f664445 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:20.954660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a97c-8beb-4722-ac71-6864ecb1a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:20.955411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a97c-8beb-4722-ac71-6864ecb1a008 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.955700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a97c-8beb-4722-ac71-6864ecb1a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.956022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a97c-8beb-4722-ac71-6864ecb1a008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.958775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000a97c-8beb-4722-ac71-6864ecb1a008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:20.958775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000a97c-8beb-4722-ac71-6864ecb1a008 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:20.968066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 769/1550] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:39:20.969024 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459239c9-c8a0-4024-bad4-7a1a882de323 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.969317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459239c9-c8a0-4024-bad4-7a1a882de323 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.969597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459239c9-c8a0-4024-bad4-7a1a882de323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.974753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 782/1551] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:20.976245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b936-7526-47c5-885a-a9d9273043d5 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:20.976550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b936-7526-47c5-885a-a9d9273043d5 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:20.976833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b936-7526-47c5-885a-a9d9273043d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:20.993008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-459239c9-c8a0-4024-bad4-7a1a882de323 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:20.994230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-459239c9-c8a0-4024-bad4-7a1a882de323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.000611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-98c5b936-7526-47c5-885a-a9d9273043d5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:21.001794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-98c5b936-7526-47c5-885a-a9d9273043d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.058570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 770/1552] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.059876 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd097499-c6dd-4efd-baa2-ed2beba564cd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.060249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd097499-c6dd-4efd-baa2-ed2beba564cd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.060496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd097499-c6dd-4efd-baa2-ed2beba564cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.062965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 783/1553] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.064304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec69990-4c80-4aa4-a01a-32b8503e677e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.064525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec69990-4c80-4aa4-a01a-32b8503e677e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.064800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec69990-4c80-4aa4-a01a-32b8503e677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.079949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-dd097499-c6dd-4efd-baa2-ed2beba564cd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:21.081212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-dd097499-c6dd-4efd-baa2-ed2beba564cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.085616 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3ec69990-4c80-4aa4-a01a-32b8503e677e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:21.087646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3ec69990-4c80-4aa4-a01a-32b8503e677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.089525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 771/1554] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.090848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b823e-e16c-4b14-9d26-b0d5200320c1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.091135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b823e-e16c-4b14-9d26-b0d5200320c1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.091452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b823e-e16c-4b14-9d26-b0d5200320c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.098691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 784/1555] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.099660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec69990-4c80-4aa4-a01a-32b8503e677e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.111361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-dd7b823e-e16c-4b14-9d26-b0d5200320c1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:21.111817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec69990-4c80-4aa4-a01a-32b8503e677e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.112600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-dd7b823e-e16c-4b14-9d26-b0d5200320c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.116526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285a7dd-5594-4b3d-94c1-f1017d9f9a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.117305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285a7dd-5594-4b3d-94c1-f1017d9f9a9c admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.117588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285a7dd-5594-4b3d-94c1-f1017d9f9a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.117887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285a7dd-5594-4b3d-94c1-f1017d9f9a9c admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.119187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285a7dd-5594-4b3d-94c1-f1017d9f9a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.121177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285a7dd-5594-4b3d-94c1-f1017d9f9a9c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.130184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 772/1556] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.130184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b823e-e16c-4b14-9d26-b0d5200320c1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.135813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b823e-e16c-4b14-9d26-b0d5200320c1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.140548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f498af-5228-4931-b000-c5bf800ea8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.141728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f498af-5228-4931-b000-c5bf800ea8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.141728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f498af-5228-4931-b000-c5bf800ea8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.141728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f498af-5228-4931-b000-c5bf800ea8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.142608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f498af-5228-4931-b000-c5bf800ea8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.144251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f498af-5228-4931-b000-c5bf800ea8f6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.154808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 773/1557] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:21.155972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17442e41-b5e0-42be-9360-a804e139c7ba None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.156283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17442e41-b5e0-42be-9360-a804e139c7ba None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.156560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17442e41-b5e0-42be-9360-a804e139c7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.174298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-17442e41-b5e0-42be-9360-a804e139c7ba None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:21.175489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-17442e41-b5e0-42be-9360-a804e139c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.183542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 774/1558] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.184318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17442e41-b5e0-42be-9360-a804e139c7ba None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.194022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17442e41-b5e0-42be-9360-a804e139c7ba None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.198789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5af92-8bac-4590-a4d7-f907cf70dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.199442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5af92-8bac-4590-a4d7-f907cf70dd55 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.199724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5af92-8bac-4590-a4d7-f907cf70dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.199998 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5af92-8bac-4590-a4d7-f907cf70dd55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.200765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5af92-8bac-4590-a4d7-f907cf70dd55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:21.201073 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5af92-8bac-4590-a4d7-f907cf70dd55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.202642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5af92-8bac-4590-a4d7-f907cf70dd55 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.205115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:21.209674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 785/1559] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:21.209674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285a7dd-5594-4b3d-94c1-f1017d9f9a9c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.217323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 775/1560] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:21.217980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285a7dd-5594-4b3d-94c1-f1017d9f9a9c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.218501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ddba-b0bf-4ec5-9d90-b52f988df058 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.218796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ddba-b0bf-4ec5-9d90-b52f988df058 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.219192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32ddba-b0bf-4ec5-9d90-b52f988df058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.222622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59c6b1-13ff-4a4c-99d2-718ac581b408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.223406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59c6b1-13ff-4a4c-99d2-718ac581b408 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.223693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59c6b1-13ff-4a4c-99d2-718ac581b408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.224390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59c6b1-13ff-4a4c-99d2-718ac581b408 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.225115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59c6b1-13ff-4a4c-99d2-718ac581b408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:21.225419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59c6b1-13ff-4a4c-99d2-718ac581b408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.226441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: WARNING py.warnings [None req-6d59c6b1-13ff-4a4c-99d2-718ac581b408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:39:21.226441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: warnings.warn(msg) Jun 16 17:39:21.226441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: Jun 16 17:39:21.227371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59c6b1-13ff-4a4c-99d2-718ac581b408 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.237839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:21.239355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6d32ddba-b0bf-4ec5-9d90-b52f988df058 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:21.239929 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6d32ddba-b0bf-4ec5-9d90-b52f988df058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.241464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 786/1561] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:21.242775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1740af-a3aa-46d0-ada9-fadca28c39fe None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.243113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1740af-a3aa-46d0-ada9-fadca28c39fe None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.243362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1740af-a3aa-46d0-ada9-fadca28c39fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.255208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 776/1562] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.256528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30cc8-7b60-40e1-9292-9d06da58895f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.256814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30cc8-7b60-40e1-9292-9d06da58895f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.257086 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30cc8-7b60-40e1-9292-9d06da58895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.265609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3d1740af-a3aa-46d0-ada9-fadca28c39fe None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:21.266816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3d1740af-a3aa-46d0-ada9-fadca28c39fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.275526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 787/1563] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.276322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1740af-a3aa-46d0-ada9-fadca28c39fe None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.277557 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b9b30cc8-7b60-40e1-9292-9d06da58895f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:21.278740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b9b30cc8-7b60-40e1-9292-9d06da58895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.285821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1740af-a3aa-46d0-ada9-fadca28c39fe None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.287416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 777/1564] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.289367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b4fc-acf8-403a-bc35-6c00a93f6cf0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.289735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b4fc-acf8-403a-bc35-6c00a93f6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.290113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b4fc-acf8-403a-bc35-6c00a93f6cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.292670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea978ef-1d0d-4e64-a1bf-29cb64613872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.293683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea978ef-1d0d-4e64-a1bf-29cb64613872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.294064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea978ef-1d0d-4e64-a1bf-29cb64613872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.294344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea978ef-1d0d-4e64-a1bf-29cb64613872 admin admin] PATH_INFO: `/v3/projects/9b63e76bf15543259db617fe9d2c5cf2/users/65a3da0b77fd473584f7e356c05890a8/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.308706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1878b4fc-acf8-403a-bc35-6c00a93f6cf0 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:21.309909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1878b4fc-acf8-403a-bc35-6c00a93f6cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.310113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea978ef-1d0d-4e64-a1bf-29cb64613872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b63e76bf15543259db617fe9d2c5cf2, user_id=65a3da0b77fd473584f7e356c05890a8, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.312840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea978ef-1d0d-4e64-a1bf-29cb64613872 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.317819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 778/1565] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.318596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b4fc-acf8-403a-bc35-6c00a93f6cf0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.328580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b4fc-acf8-403a-bc35-6c00a93f6cf0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.334192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d828-11c8-4a95-8515-4deb63cc93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.335100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d828-11c8-4a95-8515-4deb63cc93ce admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.335383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d828-11c8-4a95-8515-4deb63cc93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.335745 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d828-11c8-4a95-8515-4deb63cc93ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.336547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6d828-11c8-4a95-8515-4deb63cc93ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.338188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6d828-11c8-4a95-8515-4deb63cc93ce admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.348048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 779/1566] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:21.348817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d828-11c8-4a95-8515-4deb63cc93ce admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.358173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d828-11c8-4a95-8515-4deb63cc93ce admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.363576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7edb2-08e8-47a4-929e-7fe3192f19e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.363576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7edb2-08e8-47a4-929e-7fe3192f19e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.363576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7edb2-08e8-47a4-929e-7fe3192f19e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.363860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7edb2-08e8-47a4-929e-7fe3192f19e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.364530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7edb2-08e8-47a4-929e-7fe3192f19e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.366373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7edb2-08e8-47a4-929e-7fe3192f19e4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.389724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 788/1567] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:21 2022] PUT /identity/v3/projects/9b63e76bf15543259db617fe9d2c5cf2/users/65a3da0b77fd473584f7e356c05890a8/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:21.390658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea978ef-1d0d-4e64-a1bf-29cb64613872 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.451591 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea978ef-1d0d-4e64-a1bf-29cb64613872 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.456190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 780/1568] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:21.456960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40be12-455a-4b8f-87c7-0796ea001b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.457189 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7edb2-08e8-47a4-929e-7fe3192f19e4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.457629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40be12-455a-4b8f-87c7-0796ea001b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.457962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40be12-455a-4b8f-87c7-0796ea001b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.458335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40be12-455a-4b8f-87c7-0796ea001b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.459033 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40be12-455a-4b8f-87c7-0796ea001b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.461517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40be12-455a-4b8f-87c7-0796ea001b32 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.521005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7edb2-08e8-47a4-929e-7fe3192f19e4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.525456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f1316-21ed-4ec2-8afa-e7d8a8b315f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.526116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1316-21ed-4ec2-8afa-e7d8a8b315f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.526397 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1316-21ed-4ec2-8afa-e7d8a8b315f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.526673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1316-21ed-4ec2-8afa-e7d8a8b315f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.527380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1316-21ed-4ec2-8afa-e7d8a8b315f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:21.527691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1316-21ed-4ec2-8afa-e7d8a8b315f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.529320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1316-21ed-4ec2-8afa-e7d8a8b315f8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.540920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 781/1569] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:21.541690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f1316-21ed-4ec2-8afa-e7d8a8b315f8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.552211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f1316-21ed-4ec2-8afa-e7d8a8b315f8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.558248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 789/1570] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/projects => generated 403 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:21.558248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40be12-455a-4b8f-87c7-0796ea001b32 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.558515 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5d969-088a-4b61-8459-395aedc4edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.558515 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5d969-088a-4b61-8459-395aedc4edff admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.558515 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5d969-088a-4b61-8459-395aedc4edff admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.558795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5d969-088a-4b61-8459-395aedc4edff admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.559512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5d969-088a-4b61-8459-395aedc4edff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:21.559829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5d969-088a-4b61-8459-395aedc4edff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.561465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5d969-088a-4b61-8459-395aedc4edff admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.575100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 782/1571] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:21.576254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5d969-088a-4b61-8459-395aedc4edff admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.588275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5d969-088a-4b61-8459-395aedc4edff admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.627775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40be12-455a-4b8f-87c7-0796ea001b32 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.632597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af6e84-d423-4b18-a911-c6fcefb54a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.633267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af6e84-d423-4b18-a911-c6fcefb54a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.633551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af6e84-d423-4b18-a911-c6fcefb54a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.633834 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af6e84-d423-4b18-a911-c6fcefb54a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.634608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af6e84-d423-4b18-a911-c6fcefb54a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:21.634905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af6e84-d423-4b18-a911-c6fcefb54a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.636557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af6e84-d423-4b18-a911-c6fcefb54a5c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.643506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88c831-3a03-432e-9f15-8a7f7452551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.644217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88c831-3a03-432e-9f15-8a7f7452551b admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.644512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88c831-3a03-432e-9f15-8a7f7452551b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.644789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88c831-3a03-432e-9f15-8a7f7452551b admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.645506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88c831-3a03-432e-9f15-8a7f7452551b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:21.645817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88c831-3a03-432e-9f15-8a7f7452551b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.647394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88c831-3a03-432e-9f15-8a7f7452551b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.649095 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 790/1572] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:21.650669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af6e84-d423-4b18-a911-c6fcefb54a5c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.661208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af6e84-d423-4b18-a911-c6fcefb54a5c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.661639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 783/1573] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:21.663190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41772ab-5e3d-4b6f-8a48-c056e1d7c522 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.663487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41772ab-5e3d-4b6f-8a48-c056e1d7c522 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.663768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41772ab-5e3d-4b6f-8a48-c056e1d7c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.667495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc56750-d720-4983-8e80-29a098d499af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.668312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc56750-d720-4983-8e80-29a098d499af admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.668602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc56750-d720-4983-8e80-29a098d499af admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.669158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc56750-d720-4983-8e80-29a098d499af admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.669773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc56750-d720-4983-8e80-29a098d499af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.671381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc56750-d720-4983-8e80-29a098d499af admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.683166 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d41772ab-5e3d-4b6f-8a48-c056e1d7c522 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:21.683865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 791/1574] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:21.684405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d41772ab-5e3d-4b6f-8a48-c056e1d7c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:21.684788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc56750-d720-4983-8e80-29a098d499af admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.692342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 784/1575] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:21.693099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41772ab-5e3d-4b6f-8a48-c056e1d7c522 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.695041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc56750-d720-4983-8e80-29a098d499af admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.701126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efe71c-770b-4489-9e14-ff2bb5e98a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.702200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efe71c-770b-4489-9e14-ff2bb5e98a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.702767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efe71c-770b-4489-9e14-ff2bb5e98a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.702972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efe71c-770b-4489-9e14-ff2bb5e98a44 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.703106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41772ab-5e3d-4b6f-8a48-c056e1d7c522 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.703796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efe71c-770b-4489-9e14-ff2bb5e98a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.705814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efe71c-770b-4489-9e14-ff2bb5e98a44 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.707735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca590c5f-5fd0-4b75-8402-06a4b9a79c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.708449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca590c5f-5fd0-4b75-8402-06a4b9a79c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.708737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca590c5f-5fd0-4b75-8402-06a4b9a79c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.709015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca590c5f-5fd0-4b75-8402-06a4b9a79c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.709954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca590c5f-5fd0-4b75-8402-06a4b9a79c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.711846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca590c5f-5fd0-4b75-8402-06a4b9a79c08 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.720394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:21.824030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 792/1576] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:21.824931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efe71c-770b-4489-9e14-ff2bb5e98a44 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.834899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efe71c-770b-4489-9e14-ff2bb5e98a44 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.843291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 785/1577] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:21.843291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca590c5f-5fd0-4b75-8402-06a4b9a79c08 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.843559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df316b48-1f7b-494b-b3b9-8e1b3421603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.843559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316b48-1f7b-494b-b3b9-8e1b3421603a admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.843559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316b48-1f7b-494b-b3b9-8e1b3421603a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.843559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316b48-1f7b-494b-b3b9-8e1b3421603a admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.843924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df316b48-1f7b-494b-b3b9-8e1b3421603a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.845436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df316b48-1f7b-494b-b3b9-8e1b3421603a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.901999 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca590c5f-5fd0-4b75-8402-06a4b9a79c08 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.906864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8f865-0493-42a8-8132-486e078d61a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.907531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8f865-0493-42a8-8132-486e078d61a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.907837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8f865-0493-42a8-8132-486e078d61a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.908153 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8f865-0493-42a8-8132-486e078d61a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.908843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8f865-0493-42a8-8132-486e078d61a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.910764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8f865-0493-42a8-8132-486e078d61a6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:21.928293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 793/1578] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:21.929131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df316b48-1f7b-494b-b3b9-8e1b3421603a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:21.934683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:21.939817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df316b48-1f7b-494b-b3b9-8e1b3421603a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:21.944465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb032a8-cda3-4de0-ae5b-8a94e2e74d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:21.945101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb032a8-cda3-4de0-ae5b-8a94e2e74d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:21.945392 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb032a8-cda3-4de0-ae5b-8a94e2e74d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:21.945675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb032a8-cda3-4de0-ae5b-8a94e2e74d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:21.946349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb032a8-cda3-4de0-ae5b-8a94e2e74d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:21.948892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb032a8-cda3-4de0-ae5b-8a94e2e74d9e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.019097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 786/1579] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/projects => generated 389 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:22.022430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8f865-0493-42a8-8132-486e078d61a6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.050929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 794/1580] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:21 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:22.051764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb032a8-cda3-4de0-ae5b-8a94e2e74d9e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.086013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8f865-0493-42a8-8132-486e078d61a6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.117512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb032a8-cda3-4de0-ae5b-8a94e2e74d9e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.122852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1651-df7f-4dad-8910-e4a24bcfb885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.123753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1651-df7f-4dad-8910-e4a24bcfb885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.124042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1651-df7f-4dad-8910-e4a24bcfb885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.124360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1651-df7f-4dad-8910-e4a24bcfb885 admin admin] PATH_INFO: `/v3/projects/6c57d2f6443544a3b1848c7122deda68/users/97e53b295eb24d558023b8a120dad771/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.139621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa1651-df7f-4dad-8910-e4a24bcfb885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c57d2f6443544a3b1848c7122deda68, user_id=97e53b295eb24d558023b8a120dad771, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.142320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa1651-df7f-4dad-8910-e4a24bcfb885 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.144904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbc830-d470-4d07-94c7-e6dae65e760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.145571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbc830-d470-4d07-94c7-e6dae65e760d admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.145850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbc830-d470-4d07-94c7-e6dae65e760d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.146125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbc830-d470-4d07-94c7-e6dae65e760d admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.146808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbc830-d470-4d07-94c7-e6dae65e760d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.148728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbc830-d470-4d07-94c7-e6dae65e760d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.206515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 795/1581] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:22 2022] PUT /identity/v3/projects/6c57d2f6443544a3b1848c7122deda68/users/97e53b295eb24d558023b8a120dad771/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:22.209570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1651-df7f-4dad-8910-e4a24bcfb885 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.230727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 787/1582] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:22 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:22.233505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbc830-d470-4d07-94c7-e6dae65e760d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.240431 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:22.264892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1651-df7f-4dad-8910-e4a24bcfb885 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.293877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbc830-d470-4d07-94c7-e6dae65e760d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.298590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a0250-fb49-4593-986b-9eab30d32786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.299271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a0250-fb49-4593-986b-9eab30d32786 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.299554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a0250-fb49-4593-986b-9eab30d32786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.299831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a0250-fb49-4593-986b-9eab30d32786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.300590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a0250-fb49-4593-986b-9eab30d32786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.302221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a0250-fb49-4593-986b-9eab30d32786 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.312348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 788/1583] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:22.313214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a0250-fb49-4593-986b-9eab30d32786 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.317652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265af3aa-eb95-4369-bd0f-aa1424927518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.318302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265af3aa-eb95-4369-bd0f-aa1424927518 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.318583 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265af3aa-eb95-4369-bd0f-aa1424927518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.318851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265af3aa-eb95-4369-bd0f-aa1424927518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.325616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a0250-fb49-4593-986b-9eab30d32786 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.329093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265af3aa-eb95-4369-bd0f-aa1424927518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.330558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265af3aa-eb95-4369-bd0f-aa1424927518 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.330917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24bb35-c16d-4f0e-aca5-046ee19bf43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.331572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24bb35-c16d-4f0e-aca5-046ee19bf43a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.331852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24bb35-c16d-4f0e-aca5-046ee19bf43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.332159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24bb35-c16d-4f0e-aca5-046ee19bf43a admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.332838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24bb35-c16d-4f0e-aca5-046ee19bf43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.335002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24bb35-c16d-4f0e-aca5-046ee19bf43a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.341150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 796/1584] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:22.341883 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265af3aa-eb95-4369-bd0f-aa1424927518 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.352150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265af3aa-eb95-4369-bd0f-aa1424927518 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.357471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b2308-039b-43d5-b4a6-47ff15cb725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.358158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b2308-039b-43d5-b4a6-47ff15cb725b admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.358446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b2308-039b-43d5-b4a6-47ff15cb725b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.358720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b2308-039b-43d5-b4a6-47ff15cb725b admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.359449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b2308-039b-43d5-b4a6-47ff15cb725b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.361099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b2308-039b-43d5-b4a6-47ff15cb725b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.372638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 797/1585] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:22.373677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b2308-039b-43d5-b4a6-47ff15cb725b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.384361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b2308-039b-43d5-b4a6-47ff15cb725b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.389426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4adf57-a9c7-43d0-9abc-ed9585bae25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.393415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4adf57-a9c7-43d0-9abc-ed9585bae25e admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.393415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4adf57-a9c7-43d0-9abc-ed9585bae25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.393415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4adf57-a9c7-43d0-9abc-ed9585bae25e admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.393415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4adf57-a9c7-43d0-9abc-ed9585bae25e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.393415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4adf57-a9c7-43d0-9abc-ed9585bae25e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.402799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:22.453142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 789/1586] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:22 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:22.453833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24bb35-c16d-4f0e-aca5-046ee19bf43a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.464280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24bb35-c16d-4f0e-aca5-046ee19bf43a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.469158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd6ab-0576-4ea3-8f2d-98460e97c2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.469903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd6ab-0576-4ea3-8f2d-98460e97c2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.470195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd6ab-0576-4ea3-8f2d-98460e97c2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.470474 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd6ab-0576-4ea3-8f2d-98460e97c2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.471163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dd6ab-0576-4ea3-8f2d-98460e97c2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.473117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dd6ab-0576-4ea3-8f2d-98460e97c2e4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.489052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 798/1587] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:22 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:22.498422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3466e0-6594-47b0-9565-bd3b7c911bed None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.498422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3466e0-6594-47b0-9565-bd3b7c911bed None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.498422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3466e0-6594-47b0-9565-bd3b7c911bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.509245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-7b3466e0-6594-47b0-9565-bd3b7c911bed None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:22.510499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7b3466e0-6594-47b0-9565-bd3b7c911bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:22.518181 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 799/1588] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:22.518910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3466e0-6594-47b0-9565-bd3b7c911bed None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.528226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3466e0-6594-47b0-9565-bd3b7c911bed None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.532797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caf0bf-018d-4688-8111-de2af84d453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.533443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caf0bf-018d-4688-8111-de2af84d453b admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.533722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caf0bf-018d-4688-8111-de2af84d453b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.533994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caf0bf-018d-4688-8111-de2af84d453b admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.534666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caf0bf-018d-4688-8111-de2af84d453b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.536638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caf0bf-018d-4688-8111-de2af84d453b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.586725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 790/1589] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:22 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:22.587671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd6ab-0576-4ea3-8f2d-98460e97c2e4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.598969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd6ab-0576-4ea3-8f2d-98460e97c2e4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.604565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87aaed-05f5-407e-be90-4ae7673329f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.605237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87aaed-05f5-407e-be90-4ae7673329f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.605529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87aaed-05f5-407e-be90-4ae7673329f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.605815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87aaed-05f5-407e-be90-4ae7673329f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.606541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87aaed-05f5-407e-be90-4ae7673329f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.608256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87aaed-05f5-407e-be90-4ae7673329f0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.620331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 791/1590] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:22.621156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87aaed-05f5-407e-be90-4ae7673329f0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.630754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87aaed-05f5-407e-be90-4ae7673329f0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.636140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2ff74-2e65-48f9-84bc-ea2d12e13171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.636806 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2ff74-2e65-48f9-84bc-ea2d12e13171 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.637087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2ff74-2e65-48f9-84bc-ea2d12e13171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.637359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2ff74-2e65-48f9-84bc-ea2d12e13171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.638064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2ff74-2e65-48f9-84bc-ea2d12e13171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.639635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2ff74-2e65-48f9-84bc-ea2d12e13171 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.650686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 792/1591] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:22.651737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2ff74-2e65-48f9-84bc-ea2d12e13171 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.661213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2ff74-2e65-48f9-84bc-ea2d12e13171 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.662948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 800/1592] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:22 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:22.662948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caf0bf-018d-4688-8111-de2af84d453b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.668662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8065c47-59dd-44c4-8288-9805f62842e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.669342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065c47-59dd-44c4-8288-9805f62842e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.669617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065c47-59dd-44c4-8288-9805f62842e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.669889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065c47-59dd-44c4-8288-9805f62842e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.670653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8065c47-59dd-44c4-8288-9805f62842e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.672330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8065c47-59dd-44c4-8288-9805f62842e3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.674230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caf0bf-018d-4688-8111-de2af84d453b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.678929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6d51d-640b-4bac-8a07-7d39763e1226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.679579 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6d51d-640b-4bac-8a07-7d39763e1226 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.679862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6d51d-640b-4bac-8a07-7d39763e1226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.680160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6d51d-640b-4bac-8a07-7d39763e1226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.681015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6d51d-640b-4bac-8a07-7d39763e1226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.682772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6d51d-640b-4bac-8a07-7d39763e1226 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.682893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 793/1593] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:22.683598 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8065c47-59dd-44c4-8288-9805f62842e3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.694076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 801/1594] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:22.694271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8065c47-59dd-44c4-8288-9805f62842e3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.694395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6d51d-640b-4bac-8a07-7d39763e1226 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.698271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bebdb4-278c-4d6a-a904-e5582e24bd66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.698921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bebdb4-278c-4d6a-a904-e5582e24bd66 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.699200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bebdb4-278c-4d6a-a904-e5582e24bd66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.699478 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bebdb4-278c-4d6a-a904-e5582e24bd66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.706801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6d51d-640b-4bac-8a07-7d39763e1226 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.709726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bebdb4-278c-4d6a-a904-e5582e24bd66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.713389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bebdb4-278c-4d6a-a904-e5582e24bd66 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.714136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966d38a-fb47-4e9f-a00d-ab32c24787e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.715335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966d38a-fb47-4e9f-a00d-ab32c24787e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.715671 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966d38a-fb47-4e9f-a00d-ab32c24787e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.716179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966d38a-fb47-4e9f-a00d-ab32c24787e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.717456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966d38a-fb47-4e9f-a00d-ab32c24787e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.720341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966d38a-fb47-4e9f-a00d-ab32c24787e5 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.734578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 794/1595] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:22.736230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bebdb4-278c-4d6a-a904-e5582e24bd66 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.741926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 802/1596] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:22.741926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966d38a-fb47-4e9f-a00d-ab32c24787e5 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.754068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bebdb4-278c-4d6a-a904-e5582e24bd66 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.756619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966d38a-fb47-4e9f-a00d-ab32c24787e5 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:22.759842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9917-31b0-4a88-b2da-41e3daf7274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.761050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9917-31b0-4a88-b2da-41e3daf7274b admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.761527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9917-31b0-4a88-b2da-41e3daf7274b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.761949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9917-31b0-4a88-b2da-41e3daf7274b admin admin] PATH_INFO: `/v3/projects/bc55d9264920409794a4ded43d258274/users/766bcac7c0754e76833270c6cca8e86f/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.763119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27fccb-bbc9-497b-9db9-e79a847b176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:22.764020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27fccb-bbc9-497b-9db9-e79a847b176d admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:22.764470 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27fccb-bbc9-497b-9db9-e79a847b176d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:22.764622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27fccb-bbc9-497b-9db9-e79a847b176d admin admin] PATH_INFO: `/v3/projects/85bdc85835c24e5ebd05494d6abe4845/users/374fc5d4b4af4336b727d382b203ce31/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:22.783454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9917-31b0-4a88-b2da-41e3daf7274b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc55d9264920409794a4ded43d258274, user_id=766bcac7c0754e76833270c6cca8e86f, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.785063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: WARNING py.warnings [None req-d72a9917-31b0-4a88-b2da-41e3daf7274b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:39:22.785063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: warnings.warn(msg) Jun 16 17:39:22.785063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: Jun 16 17:39:22.789518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9917-31b0-4a88-b2da-41e3daf7274b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.794184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27fccb-bbc9-497b-9db9-e79a847b176d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bdc85835c24e5ebd05494d6abe4845, user_id=374fc5d4b4af4336b727d382b203ce31, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:22.797095 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27fccb-bbc9-497b-9db9-e79a847b176d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:22.914713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 795/1597] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:22 2022] PUT /identity/v3/projects/bc55d9264920409794a4ded43d258274/users/766bcac7c0754e76833270c6cca8e86f/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:22.916102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9917-31b0-4a88-b2da-41e3daf7274b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.944266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 803/1598] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:22 2022] PUT /identity/v3/projects/85bdc85835c24e5ebd05494d6abe4845/users/374fc5d4b4af4336b727d382b203ce31/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:22.949789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27fccb-bbc9-497b-9db9-e79a847b176d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:22.990042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:22.995095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9917-31b0-4a88-b2da-41e3daf7274b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:23.023045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27fccb-bbc9-497b-9db9-e79a847b176d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:23.030249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e887f4f-cb2b-4357-a371-386f37b9d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:23.030943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e887f4f-cb2b-4357-a371-386f37b9d4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.031229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e887f4f-cb2b-4357-a371-386f37b9d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.031504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e887f4f-cb2b-4357-a371-386f37b9d4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.032258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e887f4f-cb2b-4357-a371-386f37b9d4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:23.034145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e887f4f-cb2b-4357-a371-386f37b9d4fb admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:23.055554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 804/1599] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:23.057290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e887f4f-cb2b-4357-a371-386f37b9d4fb admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:23.068948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd94064-b8cc-4945-9553-b10acfd98136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:23.069674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd94064-b8cc-4945-9553-b10acfd98136 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.069961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd94064-b8cc-4945-9553-b10acfd98136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.070233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd94064-b8cc-4945-9553-b10acfd98136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.070982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd94064-b8cc-4945-9553-b10acfd98136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:23.074819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd94064-b8cc-4945-9553-b10acfd98136 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:23.074976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e887f4f-cb2b-4357-a371-386f37b9d4fb admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:23.090542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82cc7b-b904-404a-abd3-68c045eb2f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:23.090754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 796/1600] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:23.090845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82cc7b-b904-404a-abd3-68c045eb2f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.090845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82cc7b-b904-404a-abd3-68c045eb2f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.091036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd94064-b8cc-4945-9553-b10acfd98136 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:23.091125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82cc7b-b904-404a-abd3-68c045eb2f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.091125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82cc7b-b904-404a-abd3-68c045eb2f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:23.091125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82cc7b-b904-404a-abd3-68c045eb2f32 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:23.103790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd94064-b8cc-4945-9553-b10acfd98136 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:23.108467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 805/1601] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:23.112914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3657a-30b4-4786-a4f9-4c6ed5262445 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.112914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3657a-30b4-4786-a4f9-4c6ed5262445 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.113144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd24d0a-9bbd-4ec3-8d5f-47c1271fcc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:23.113263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3657a-30b4-4786-a4f9-4c6ed5262445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.113341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24d0a-9bbd-4ec3-8d5f-47c1271fcc02 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.113341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24d0a-9bbd-4ec3-8d5f-47c1271fcc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.113341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24d0a-9bbd-4ec3-8d5f-47c1271fcc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.113341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd24d0a-9bbd-4ec3-8d5f-47c1271fcc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:23.116600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd24d0a-9bbd-4ec3-8d5f-47c1271fcc02 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:23.131134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 797/1602] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:23.131134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2830b-6851-462c-b64b-ee45ae707c1d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.131134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2830b-6851-462c-b64b-ee45ae707c1d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.131134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2830b-6851-462c-b64b-ee45ae707c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.152312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-cbd3657a-30b4-4786-a4f9-4c6ed5262445 None None] MFA Rules not processed for user `766bcac7c0754e76833270c6cca8e86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:23.153696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cbd3657a-30b4-4786-a4f9-4c6ed5262445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:23.154736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8fe2830b-6851-462c-b64b-ee45ae707c1d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:23.155925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8fe2830b-6851-462c-b64b-ee45ae707c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:23.166924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 798/1603] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:23.166924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2830b-6851-462c-b64b-ee45ae707c1d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:23.175072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2830b-6851-462c-b64b-ee45ae707c1d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:23.181980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d64611-cd06-4b6f-8ee0-820a41535c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:23.181980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d64611-cd06-4b6f-8ee0-820a41535c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.181980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d64611-cd06-4b6f-8ee0-820a41535c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.181980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d64611-cd06-4b6f-8ee0-820a41535c12 admin admin] PATH_INFO: `/v3/projects/9676786323cb499bb6d6dfe90e6abc66/users/14ee3f3d50724574b17fa17c1b5e5a7e/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.196383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d64611-cd06-4b6f-8ee0-820a41535c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9676786323cb499bb6d6dfe90e6abc66, user_id=14ee3f3d50724574b17fa17c1b5e5a7e, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:23.200023 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d64611-cd06-4b6f-8ee0-820a41535c12 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:23.226553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:23.232622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 806/1604] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:23.233447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3657a-30b4-4786-a4f9-4c6ed5262445 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:23.245623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3657a-30b4-4786-a4f9-4c6ed5262445 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:23.262368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d77e-998b-4447-994e-475935d6438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:23.263195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d77e-998b-4447-994e-475935d6438f admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.263585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d77e-998b-4447-994e-475935d6438f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.265185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d77e-998b-4447-994e-475935d6438f admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.265930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37d77e-998b-4447-994e-475935d6438f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:23.269844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37d77e-998b-4447-994e-475935d6438f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:23.281898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 807/1605] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:23.281898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d77e-998b-4447-994e-475935d6438f admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:23.294788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d77e-998b-4447-994e-475935d6438f admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:23.308221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 799/1606] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:23 2022] PUT /identity/v3/projects/9676786323cb499bb6d6dfe90e6abc66/users/14ee3f3d50724574b17fa17c1b5e5a7e/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:23.308849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d64611-cd06-4b6f-8ee0-820a41535c12 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:23.316252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16365b-2d55-46d3-94c0-58015ad140db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:23.317582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16365b-2d55-46d3-94c0-58015ad140db admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.318039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16365b-2d55-46d3-94c0-58015ad140db admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.318439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16365b-2d55-46d3-94c0-58015ad140db admin admin] PATH_INFO: `/v3/projects/fc2020c863b74fcf914fe647b64fba63/users/f814a06f54894fa2992d3ba3be21b4db/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.345489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16365b-2d55-46d3-94c0-58015ad140db admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2020c863b74fcf914fe647b64fba63, user_id=f814a06f54894fa2992d3ba3be21b4db, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:23.348898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16365b-2d55-46d3-94c0-58015ad140db admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:23.392502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d64611-cd06-4b6f-8ee0-820a41535c12 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:23.397746 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4242-a10d-4816-abec-25deba512642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:23.398615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4242-a10d-4816-abec-25deba512642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.398897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4242-a10d-4816-abec-25deba512642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.399173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4242-a10d-4816-abec-25deba512642 admin admin] PATH_INFO: `/v3/projects/41640d5ecd5a48bf999ba0b8a57284b3/users/28c031d2975a45beba19a6dbfaa691c6/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.415737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c4242-a10d-4816-abec-25deba512642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41640d5ecd5a48bf999ba0b8a57284b3, user_id=28c031d2975a45beba19a6dbfaa691c6, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:23.418511 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c4242-a10d-4816-abec-25deba512642 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:23.523145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 808/1607] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:23 2022] PUT /identity/v3/projects/fc2020c863b74fcf914fe647b64fba63/users/f814a06f54894fa2992d3ba3be21b4db/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:23.524164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16365b-2d55-46d3-94c0-58015ad140db admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:23.582809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 800/1608] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:23 2022] PUT /identity/v3/projects/41640d5ecd5a48bf999ba0b8a57284b3/users/28c031d2975a45beba19a6dbfaa691c6/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:23.586648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdf43f-b60d-4469-bbcc-6d7833a7ca9b None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.586648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdf43f-b60d-4469-bbcc-6d7833a7ca9b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.586648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdf43f-b60d-4469-bbcc-6d7833a7ca9b None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.586648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 801/1609] 10.222.0.77 () {54 vars in 961 bytes} [Thu Jun 16 17:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:39:23.597723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdf43f-b60d-4469-bbcc-6d7833a7ca9b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:23.601767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16365b-2d55-46d3-94c0-58015ad140db admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:23.667326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:23.671341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb923c3-7f59-46b8-b957-2c2d7d855ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:23.672141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb923c3-7f59-46b8-b957-2c2d7d855ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.672552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb923c3-7f59-46b8-b957-2c2d7d855ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.672870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb923c3-7f59-46b8-b957-2c2d7d855ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.689518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdf43f-b60d-4469-bbcc-6d7833a7ca9b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:23.695298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2b527-7840-4ac2-b9e0-44bb22c3ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:23.695516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2b527-7840-4ac2-b9e0-44bb22c3ef0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.695808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2b527-7840-4ac2-b9e0-44bb22c3ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.696128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2b527-7840-4ac2-b9e0-44bb22c3ef0f admin admin] PATH_INFO: `/v3/projects/925496c9825e4d55a7945f8bf5023a9d/users/91490ac252be46efb97d8af5a1357863/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.713035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2b527-7840-4ac2-b9e0-44bb22c3ef0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=925496c9825e4d55a7945f8bf5023a9d, user_id=91490ac252be46efb97d8af5a1357863, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:23.715691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2b527-7840-4ac2-b9e0-44bb22c3ef0f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:23.737758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb923c3-7f59-46b8-b957-2c2d7d855ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:23.739205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb923c3-7f59-46b8-b957-2c2d7d855ed1 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:23.749865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 809/1610] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:23.751201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1921e-f7b9-4b4b-8155-423fe42396c1 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.751499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1921e-f7b9-4b4b-8155-423fe42396c1 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.751780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1921e-f7b9-4b4b-8155-423fe42396c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.779886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-f1b1921e-f7b9-4b4b-8155-423fe42396c1 None None] MFA Rules not processed for user `14ee3f3d50724574b17fa17c1b5e5a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:23.781262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f1b1921e-f7b9-4b4b-8155-423fe42396c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:23.802967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:23.805057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 802/1611] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:23 2022] PUT /identity/v3/projects/925496c9825e4d55a7945f8bf5023a9d/users/91490ac252be46efb97d8af5a1357863/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:23.810958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fa976-d9fc-4809-9afa-f11c3ae241e7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.810958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fa976-d9fc-4809-9afa-f11c3ae241e7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.810958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fa976-d9fc-4809-9afa-f11c3ae241e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.828772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c62fa976-d9fc-4809-9afa-f11c3ae241e7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:23.830048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c62fa976-d9fc-4809-9afa-f11c3ae241e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:23.862728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 810/1612] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:23.864111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966f72-6dc0-408a-8f4f-5d8db622f110 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.864474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966f72-6dc0-408a-8f4f-5d8db622f110 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.864841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966f72-6dc0-408a-8f4f-5d8db622f110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.883251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-fe966f72-6dc0-408a-8f4f-5d8db622f110 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:23.884563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fe966f72-6dc0-408a-8f4f-5d8db622f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:23.897718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 803/1613] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:23.899195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e64e5-e4cb-44c8-b396-215ee2e66f1f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:23.899497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e64e5-e4cb-44c8-b396-215ee2e66f1f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:23.904284 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e64e5-e4cb-44c8-b396-215ee2e66f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:23.927841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-4b8e64e5-e4cb-44c8-b396-215ee2e66f1f None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:23.930248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4b8e64e5-e4cb-44c8-b396-215ee2e66f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:24.027800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 811/1614] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:24.031500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82d2d-89ef-4938-8ecf-de514a67ca38 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.031500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82d2d-89ef-4938-8ecf-de514a67ca38 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.031500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82d2d-89ef-4938-8ecf-de514a67ca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.050436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 804/1615] 10.222.0.77 () {58 vars in 1058 bytes} [Thu Jun 16 17:39:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:24.051727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e64e5-e4cb-44c8-b396-215ee2e66f1f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:24.067179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e64e5-e4cb-44c8-b396-215ee2e66f1f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:24.077946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771886fa-9c2f-49c1-9ba4-cce7b946713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:24.077946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771886fa-9c2f-49c1-9ba4-cce7b946713a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.077946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771886fa-9c2f-49c1-9ba4-cce7b946713a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.077946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771886fa-9c2f-49c1-9ba4-cce7b946713a admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.078549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771886fa-9c2f-49c1-9ba4-cce7b946713a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:24.078688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-11f82d2d-89ef-4938-8ecf-de514a67ca38 None None] MFA Rules not processed for user `91490ac252be46efb97d8af5a1357863`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:24.078826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771886fa-9c2f-49c1-9ba4-cce7b946713a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:24.079948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-11f82d2d-89ef-4938-8ecf-de514a67ca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:24.173319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 812/1616] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:24.174260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f82d2d-89ef-4938-8ecf-de514a67ca38 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:24.175721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-11f82d2d-89ef-4938-8ecf-de514a67ca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:24.186444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 805/1617] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:24 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:24.187317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771886fa-9c2f-49c1-9ba4-cce7b946713a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:24.191372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-771886fa-9c2f-49c1-9ba4-cce7b946713a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:24.249652 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:24.273250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771886fa-9c2f-49c1-9ba4-cce7b946713a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:24.278451 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:24.280503 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54066c05-c70c-4307-a26a-da3b003f02cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:24.281811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54066c05-c70c-4307-a26a-da3b003f02cc service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.282341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54066c05-c70c-4307-a26a-da3b003f02cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.283836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54066c05-c70c-4307-a26a-da3b003f02cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.284995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f82d2d-89ef-4938-8ecf-de514a67ca38 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:24.294357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be34f2d-a35e-4408-bbf3-0ec7f10f7994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:24.295834 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34f2d-a35e-4408-bbf3-0ec7f10f7994 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.302776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34f2d-a35e-4408-bbf3-0ec7f10f7994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.302776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34f2d-a35e-4408-bbf3-0ec7f10f7994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.387537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be34f2d-a35e-4408-bbf3-0ec7f10f7994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:24.390359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be34f2d-a35e-4408-bbf3-0ec7f10f7994 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:24.397399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54066c05-c70c-4307-a26a-da3b003f02cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:24.400824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54066c05-c70c-4307-a26a-da3b003f02cc service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:24.404123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 813/1618] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:24.406301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be34f2d-a35e-4408-bbf3-0ec7f10f7994 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:24.429592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 806/1619] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:24.430456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54066c05-c70c-4307-a26a-da3b003f02cc service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:24.455266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54066c05-c70c-4307-a26a-da3b003f02cc service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:24.473413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535e793-f078-466a-840f-22d624d526ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:24.474207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535e793-f078-466a-840f-22d624d526ce admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.474582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535e793-f078-466a-840f-22d624d526ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.474982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535e793-f078-466a-840f-22d624d526ce admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.475777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535e793-f078-466a-840f-22d624d526ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:24.479069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535e793-f078-466a-840f-22d624d526ce admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:24.498756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be34f2d-a35e-4408-bbf3-0ec7f10f7994 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:24.506137 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8208c81-6399-4ba3-84b2-951c9bbdcb93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:24.506863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8208c81-6399-4ba3-84b2-951c9bbdcb93 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.507179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8208c81-6399-4ba3-84b2-951c9bbdcb93 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.507465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8208c81-6399-4ba3-84b2-951c9bbdcb93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.586312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8208c81-6399-4ba3-84b2-951c9bbdcb93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:24.589427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8208c81-6399-4ba3-84b2-951c9bbdcb93 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:24.617129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 807/1620] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:24 2022] POST /identity/v3/users => generated 307 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:24.617242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 814/1621] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:24.617324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cc446-b74b-453e-9707-f816b688f4d4 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.617324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cc446-b74b-453e-9707-f816b688f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.617324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cc446-b74b-453e-9707-f816b688f4d4 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.617533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8208c81-6399-4ba3-84b2-951c9bbdcb93 service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:24.617630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 808/1622] 10.222.0.77 () {54 vars in 961 bytes} [Thu Jun 16 17:39:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:39:24.621870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675d85-c3c3-4e0e-8b19-c35de2997041 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.622278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675d85-c3c3-4e0e-8b19-c35de2997041 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.622566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675d85-c3c3-4e0e-8b19-c35de2997041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.631515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8208c81-6399-4ba3-84b2-951c9bbdcb93 service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:24.638890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbaa90-bc0b-4eab-9394-4b8660d65595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:24.644670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbaa90-bc0b-4eab-9394-4b8660d65595 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.644670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbaa90-bc0b-4eab-9394-4b8660d65595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.644670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbaa90-bc0b-4eab-9394-4b8660d65595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.644670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbaa90-bc0b-4eab-9394-4b8660d65595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:24.644670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbaa90-bc0b-4eab-9394-4b8660d65595 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:24.664223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-06675d85-c3c3-4e0e-8b19-c35de2997041 None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:24.665496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-06675d85-c3c3-4e0e-8b19-c35de2997041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:24.676419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 815/1623] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:39:24.677442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbaa90-bc0b-4eab-9394-4b8660d65595 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:24.691442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbaa90-bc0b-4eab-9394-4b8660d65595 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:24.697750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 809/1624] 10.222.0.77 () {58 vars in 1058 bytes} [Thu Jun 16 17:39:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:24.706841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675d85-c3c3-4e0e-8b19-c35de2997041 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:24.709936 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b15948-8f52-45e1-91ff-20d1e047c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:24.711513 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15948-8f52-45e1-91ff-20d1e047c423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.711921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15948-8f52-45e1-91ff-20d1e047c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.712909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15948-8f52-45e1-91ff-20d1e047c423 admin admin] PATH_INFO: `/v3/projects/0e24a8064ceb4339a2a8cf0e8c35366c/users/5990681be49f4a0a8e98cf4436c45074/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.722937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675d85-c3c3-4e0e-8b19-c35de2997041 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:24.735332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b15948-8f52-45e1-91ff-20d1e047c423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e24a8064ceb4339a2a8cf0e8c35366c, user_id=5990681be49f4a0a8e98cf4436c45074, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:24.736299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fa16e-ad35-435c-8a5b-92be0987b68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:24.736967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa16e-ad35-435c-8a5b-92be0987b68e service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.737250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa16e-ad35-435c-8a5b-92be0987b68e service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.737525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa16e-ad35-435c-8a5b-92be0987b68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.740484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b15948-8f52-45e1-91ff-20d1e047c423 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:24.831283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 816/1625] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:24 2022] PUT /identity/v3/projects/0e24a8064ceb4339a2a8cf0e8c35366c/users/5990681be49f4a0a8e98cf4436c45074/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:24.836471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b15948-8f52-45e1-91ff-20d1e047c423 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:24.846661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fa16e-ad35-435c-8a5b-92be0987b68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:24.849970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fa16e-ad35-435c-8a5b-92be0987b68e service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:24.888454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 810/1626] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:39:24.975668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b15948-8f52-45e1-91ff-20d1e047c423 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:24.990649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916f948-d870-473c-b3c8-8802ae5f86fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:24.991348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f948-d870-473c-b3c8-8802ae5f86fd admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:24.991689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f948-d870-473c-b3c8-8802ae5f86fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:24.992268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f948-d870-473c-b3c8-8802ae5f86fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:24.994642 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916f948-d870-473c-b3c8-8802ae5f86fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:24.999346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916f948-d870-473c-b3c8-8802ae5f86fd admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:25.017358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:25.021423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad6714-3d47-449d-b55c-34592c5865ae None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:25.022038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad6714-3d47-449d-b55c-34592c5865ae None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:25.022038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad6714-3d47-449d-b55c-34592c5865ae None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:25.025170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 811/1627] 10.222.0.77 () {54 vars in 912 bytes} [Thu Jun 16 17:39:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:39:25.031453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199fe8-3eef-4489-a673-5eef62e5eb84 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:25.031453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199fe8-3eef-4489-a673-5eef62e5eb84 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:25.038469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 817/1628] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:25.041229 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199fe8-3eef-4489-a673-5eef62e5eb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:25.041697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916f948-d870-473c-b3c8-8802ae5f86fd admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:25.073353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916f948-d870-473c-b3c8-8802ae5f86fd admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:25.088176 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2380a-cb00-4133-a3ce-17fc7339642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:25.088417 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9a199fe8-3eef-4489-a673-5eef62e5eb84 None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:25.092037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2380a-cb00-4133-a3ce-17fc7339642e admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:25.092451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9a199fe8-3eef-4489-a673-5eef62e5eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:25.092764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2380a-cb00-4133-a3ce-17fc7339642e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:25.093207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2380a-cb00-4133-a3ce-17fc7339642e admin admin] PATH_INFO: `/v3/projects/0e24a8064ceb4339a2a8cf0e8c35366c/users/5990681be49f4a0a8e98cf4436c45074/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:25.096665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2380a-cb00-4133-a3ce-17fc7339642e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e24a8064ceb4339a2a8cf0e8c35366c, user_id=5990681be49f4a0a8e98cf4436c45074, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:25.099922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2380a-cb00-4133-a3ce-17fc7339642e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:25.115079 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 818/1629] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:25 2022] PUT /identity/v3/projects/0e24a8064ceb4339a2a8cf0e8c35366c/users/5990681be49f4a0a8e98cf4436c45074/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:25.127277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4ed4f-51ee-47b5-8977-9655a6d2aeb3 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:25.127672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4ed4f-51ee-47b5-8977-9655a6d2aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:25.128108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4ed4f-51ee-47b5-8977-9655a6d2aeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:25.195697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a9c4ed4f-51ee-47b5-8977-9655a6d2aeb3 None None] MFA Rules not processed for user `5990681be49f4a0a8e98cf4436c45074`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:25.201922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a9c4ed4f-51ee-47b5-8977-9655a6d2aeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:25.274836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 812/1630] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:39:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:39:25.287329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a199fe8-3eef-4489-a673-5eef62e5eb84 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:25.379581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:25.387152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 819/1631] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:39:25.401081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4ed4f-51ee-47b5-8977-9655a6d2aeb3 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:25.437126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a199fe8-3eef-4489-a673-5eef62e5eb84 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:25.577040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4ed4f-51ee-47b5-8977-9655a6d2aeb3 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:25.587036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ba006-877d-4579-8a05-d2dc3ff2cb06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:25.588140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba006-877d-4579-8a05-d2dc3ff2cb06 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:25.589091 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dfd91-6c77-4be6-8bf2-704c67121a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:25.589775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dfd91-6c77-4be6-8bf2-704c67121a8a service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:25.590442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dfd91-6c77-4be6-8bf2-704c67121a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:25.590442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dfd91-6c77-4be6-8bf2-704c67121a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:25.590974 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba006-877d-4579-8a05-d2dc3ff2cb06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:25.591265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba006-877d-4579-8a05-d2dc3ff2cb06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:25.623955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dfd91-6c77-4be6-8bf2-704c67121a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:25.625795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dfd91-6c77-4be6-8bf2-704c67121a8a service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:25.648715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 820/1632] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:25 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:25.650933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123507-a358-4caa-b58a-c2c43fb39b19 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:25.651378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123507-a358-4caa-b58a-c2c43fb39b19 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:25.654086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123507-a358-4caa-b58a-c2c43fb39b19 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:25.654086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 821/1633] 10.222.0.77 () {54 vars in 912 bytes} [Thu Jun 16 17:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:39:25.659600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470426c9-878a-4d41-9cb6-f79c5319b7f0 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:25.660176 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470426c9-878a-4d41-9cb6-f79c5319b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:25.660617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470426c9-878a-4d41-9cb6-f79c5319b7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:25.694258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-470426c9-878a-4d41-9cb6-f79c5319b7f0 None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:25.699215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-470426c9-878a-4d41-9cb6-f79c5319b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:25.714197 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ba006-877d-4579-8a05-d2dc3ff2cb06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:25.715988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ba006-877d-4579-8a05-d2dc3ff2cb06 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:25.734364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 822/1634] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:39:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:39:25.735737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 813/1635] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:25.803623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470426c9-878a-4d41-9cb6-f79c5319b7f0 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:25.829143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470426c9-878a-4d41-9cb6-f79c5319b7f0 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:25.847644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9f1c0-28e0-493a-a2ff-d5640eccd0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:25.849112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9f1c0-28e0-493a-a2ff-d5640eccd0bc service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:25.849112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9f1c0-28e0-493a-a2ff-d5640eccd0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:25.849369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9f1c0-28e0-493a-a2ff-d5640eccd0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:25.874688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9f1c0-28e0-493a-a2ff-d5640eccd0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:25.877464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9f1c0-28e0-493a-a2ff-d5640eccd0bc service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:25.905414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 823/1636] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:26.430501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:26.644244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0b5a9-11a1-4b69-8f31-42ce03d5a77a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:26.644733 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0b5a9-11a1-4b69-8f31-42ce03d5a77a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:26.646142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0b5a9-11a1-4b69-8f31-42ce03d5a77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:26.704326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9dd0b5a9-11a1-4b69-8f31-42ce03d5a77a None None] MFA Rules not processed for user `374fc5d4b4af4336b727d382b203ce31`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:26.706184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9dd0b5a9-11a1-4b69-8f31-42ce03d5a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:26.803223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:26.854560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 814/1637] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:26.858057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9f1c0-28e0-493a-a2ff-d5640eccd0bc service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:26.990271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9f1c0-28e0-493a-a2ff-d5640eccd0bc service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:26.997473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d6fac-4477-4875-8570-dc828f03a763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:26.998240 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6fac-4477-4875-8570-dc828f03a763 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:26.998532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6fac-4477-4875-8570-dc828f03a763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:26.998815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6fac-4477-4875-8570-dc828f03a763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:26.999547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d6fac-4477-4875-8570-dc828f03a763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:27.002078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d6fac-4477-4875-8570-dc828f03a763 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:27.144844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 824/1638] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:26 2022] POST /identity/v3/projects => generated 405 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:27.146005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0b5a9-11a1-4b69-8f31-42ce03d5a77a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:27.178328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0b5a9-11a1-4b69-8f31-42ce03d5a77a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:27.385958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136c1c2-ecb6-44b6-a97b-f36a741993b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:27.386660 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c1c2-ecb6-44b6-a97b-f36a741993b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:27.386944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c1c2-ecb6-44b6-a97b-f36a741993b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:27.387336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c1c2-ecb6-44b6-a97b-f36a741993b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:27.388040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136c1c2-ecb6-44b6-a97b-f36a741993b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:27.390970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136c1c2-ecb6-44b6-a97b-f36a741993b8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:27.523587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 815/1639] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:27 2022] POST /identity/v3/users => generated 309 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:27.525589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d6fac-4477-4875-8570-dc828f03a763 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:27.556999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d6fac-4477-4875-8570-dc828f03a763 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:27.578169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7b34f-92dd-4601-99b8-b24401f905b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:27.588957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7b34f-92dd-4601-99b8-b24401f905b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:27.589332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7b34f-92dd-4601-99b8-b24401f905b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:27.589630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7b34f-92dd-4601-99b8-b24401f905b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:27.590422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7b34f-92dd-4601-99b8-b24401f905b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:27.595788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7b34f-92dd-4601-99b8-b24401f905b5 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:27.659304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 825/1640] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:27.665828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136c1c2-ecb6-44b6-a97b-f36a741993b8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:27.676277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7b34f-92dd-4601-99b8-b24401f905b5 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:27.690581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136c1c2-ecb6-44b6-a97b-f36a741993b8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:27.702565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60972ad-6123-413d-934b-1f730ab1ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:27.705006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60972ad-6123-413d-934b-1f730ab1ea01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:27.705217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60972ad-6123-413d-934b-1f730ab1ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:27.706420 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60972ad-6123-413d-934b-1f730ab1ea01 admin admin] PATH_INFO: `/v3/projects/bd72c163467d4b05a6e9e8901ec2bf73/users/8ed1acc1f1d149acbdd6c8b2bc1ff125/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:27.738788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60972ad-6123-413d-934b-1f730ab1ea01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd72c163467d4b05a6e9e8901ec2bf73, user_id=8ed1acc1f1d149acbdd6c8b2bc1ff125, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:27.741719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60972ad-6123-413d-934b-1f730ab1ea01 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:27.859432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7b34f-92dd-4601-99b8-b24401f905b5 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:27.865201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8832f65-952a-40b2-a896-87500f0644fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:27.866085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8832f65-952a-40b2-a896-87500f0644fd service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:27.866510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8832f65-952a-40b2-a896-87500f0644fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:27.866917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8832f65-952a-40b2-a896-87500f0644fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:27.888947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 816/1641] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:27 2022] PUT /identity/v3/projects/bd72c163467d4b05a6e9e8901ec2bf73/users/8ed1acc1f1d149acbdd6c8b2bc1ff125/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:27.890318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60972ad-6123-413d-934b-1f730ab1ea01 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:27.982239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8832f65-952a-40b2-a896-87500f0644fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:27.983747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8832f65-952a-40b2-a896-87500f0644fd service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:28.011793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 826/1642] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:28.038550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60972ad-6123-413d-934b-1f730ab1ea01 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:28.044625 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdceed1-eb1f-40e2-abb5-880d34a95e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:28.045526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdceed1-eb1f-40e2-abb5-880d34a95e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:28.045906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdceed1-eb1f-40e2-abb5-880d34a95e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:28.047718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdceed1-eb1f-40e2-abb5-880d34a95e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:28.049429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdceed1-eb1f-40e2-abb5-880d34a95e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:28.053787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdceed1-eb1f-40e2-abb5-880d34a95e43 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:28.091317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 817/1643] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:28.095195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8832f65-952a-40b2-a896-87500f0644fd service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:28.112684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8832f65-952a-40b2-a896-87500f0644fd service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:28.131286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff300e7-e171-4db0-a972-5ca81bb464f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:28.132403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff300e7-e171-4db0-a972-5ca81bb464f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:28.132687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff300e7-e171-4db0-a972-5ca81bb464f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:28.132970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff300e7-e171-4db0-a972-5ca81bb464f5 admin admin] PATH_INFO: `/v3/projects/bd72c163467d4b05a6e9e8901ec2bf73/users/8ed1acc1f1d149acbdd6c8b2bc1ff125/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:28.135707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff300e7-e171-4db0-a972-5ca81bb464f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd72c163467d4b05a6e9e8901ec2bf73, user_id=8ed1acc1f1d149acbdd6c8b2bc1ff125, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:28.139598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff300e7-e171-4db0-a972-5ca81bb464f5 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:28.172587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 827/1644] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:28 2022] PUT /identity/v3/projects/bd72c163467d4b05a6e9e8901ec2bf73/users/8ed1acc1f1d149acbdd6c8b2bc1ff125/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:31.944845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdceed1-eb1f-40e2-abb5-880d34a95e43 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:31.963440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdceed1-eb1f-40e2-abb5-880d34a95e43 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:32.081754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:32.128196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:32.129078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:32.129368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:32.132541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] PATH_INFO: `/v3/users/91490ac252be46efb97d8af5a1357863` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:32.136403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91490ac252be46efb97d8af5a1357863)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:32.137608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: WARNING py.warnings [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:39:32.137608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: warnings.warn(msg) Jun 16 17:39:32.137608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: Jun 16 17:39:32.138930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:32.139414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb7e5d-9d56-4a4f-be08-075ac28987b0 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:32.140485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb7e5d-9d56-4a4f-be08-075ac28987b0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:32.141277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb7e5d-9d56-4a4f-be08-075ac28987b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:32.172260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:32.196780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-57bb7e5d-9d56-4a4f-be08-075ac28987b0 None None] MFA Rules not processed for user `8ed1acc1f1d149acbdd6c8b2bc1ff125`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:32.199144 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-57bb7e5d-9d56-4a4f-be08-075ac28987b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:32.357264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 828/1645] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:32.481114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91490ac252be46efb97d8af5a1357863'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:32.523833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91490ac252be46efb97d8af5a1357863'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:32.623845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91490ac252be46efb97d8af5a1357863'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:32.625200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91490ac252be46efb97d8af5a1357863'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:32.626034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91490ac252be46efb97d8af5a1357863'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:32.667854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 818/1646] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:39:31 2022] DELETE /identity/v3/users/91490ac252be46efb97d8af5a1357863 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:32.670308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec74be6-9b9a-48bc-9363-f450e0b12709 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:32.670722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec74be6-9b9a-48bc-9363-f450e0b12709 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:32.671168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec74be6-9b9a-48bc-9363-f450e0b12709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:32.743998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3ec74be6-9b9a-48bc-9363-f450e0b12709 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:32.753776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3ec74be6-9b9a-48bc-9363-f450e0b12709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:33.083063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 829/1647] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:33.105938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:33.108027 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:33.307843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828c5f-6f82-4148-afe8-54d2f6992009 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:33.326633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc470f84-5bae-40ae-85ee-f221353110e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:33.336645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc470f84-5bae-40ae-85ee-f221353110e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:33.337019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc470f84-5bae-40ae-85ee-f221353110e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:33.337310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc470f84-5bae-40ae-85ee-f221353110e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:33.377917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc470f84-5bae-40ae-85ee-f221353110e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:33.383842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc470f84-5bae-40ae-85ee-f221353110e3 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:33.430193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 819/1648] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:34.395804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e26339-41af-4d69-9197-5c562b4c5544 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:34.396386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e26339-41af-4d69-9197-5c562b4c5544 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:34.396481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e26339-41af-4d69-9197-5c562b4c5544 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:34.398330 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 830/1649] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:39:34.528806 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78bd32-9dc0-4b43-8be0-0754cffa438e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:34.530075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78bd32-9dc0-4b43-8be0-0754cffa438e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:34.530525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78bd32-9dc0-4b43-8be0-0754cffa438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:34.553227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3e78bd32-9dc0-4b43-8be0-0754cffa438e None None] MFA Rules not processed for user `a2909d4015ac45fcaf6d1fc8e488aa44`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:34.556712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3e78bd32-9dc0-4b43-8be0-0754cffa438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:34.674002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e26339-41af-4d69-9197-5c562b4c5544 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:34.678689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-63e26339-41af-4d69-9197-5c562b4c5544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:34.693710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:34.716688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 820/1650] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:39:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:34.726704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e26339-41af-4d69-9197-5c562b4c5544 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:34.740743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:34.741726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:34.742085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:34.743041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] PATH_INFO: `/v3/users/766bcac7c0754e76833270c6cca8e86f` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:34.753636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf46547-336e-4aec-8a16-96f2282dd024 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:34.753798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766bcac7c0754e76833270c6cca8e86f)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:34.756274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf46547-336e-4aec-8a16-96f2282dd024 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:34.756274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf46547-336e-4aec-8a16-96f2282dd024 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:34.756274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 821/1651] 10.222.0.77 () {54 vars in 960 bytes} [Thu Jun 16 17:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:39:34.761975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a93e5-4953-4f86-b55a-64a3aee38dc9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:34.762433 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a93e5-4953-4f86-b55a-64a3aee38dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:34.762797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a93e5-4953-4f86-b55a-64a3aee38dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:34.765294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:34.813781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f11a93e5-4953-4f86-b55a-64a3aee38dc9 None None] MFA Rules not processed for user `a2909d4015ac45fcaf6d1fc8e488aa44`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:34.816680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f11a93e5-4953-4f86-b55a-64a3aee38dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:34.828483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 822/1652] 10.222.0.77 () {58 vars in 1057 bytes} [Thu Jun 16 17:39:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:39:34.840572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a93e5-4953-4f86-b55a-64a3aee38dc9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:34.861478 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a93e5-4953-4f86-b55a-64a3aee38dc9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:34.872736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6ab35-2c4f-4b5f-ab26-bad71a6caf87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:34.874555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ab35-2c4f-4b5f-ab26-bad71a6caf87 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:34.875294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ab35-2c4f-4b5f-ab26-bad71a6caf87 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:34.876288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ab35-2c4f-4b5f-ab26-bad71a6caf87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:34.901359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6ab35-2c4f-4b5f-ab26-bad71a6caf87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:34.903277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6ab35-2c4f-4b5f-ab26-bad71a6caf87 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:34.936596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 823/1653] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:34.991674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766bcac7c0754e76833270c6cca8e86f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:35.027796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766bcac7c0754e76833270c6cca8e86f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:35.168128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766bcac7c0754e76833270c6cca8e86f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:35.168774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766bcac7c0754e76833270c6cca8e86f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:35.169445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766bcac7c0754e76833270c6cca8e86f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:35.197559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 831/1654] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:39:34 2022] DELETE /identity/v3/users/766bcac7c0754e76833270c6cca8e86f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:35.203592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06cb3e-61a9-4964-8a18-a19aaf4d3fa2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:35.204673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06cb3e-61a9-4964-8a18-a19aaf4d3fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:35.208608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06cb3e-61a9-4964-8a18-a19aaf4d3fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:35.240261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bf06cb3e-61a9-4964-8a18-a19aaf4d3fa2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:35.242345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bf06cb3e-61a9-4964-8a18-a19aaf4d3fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:35.341152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 824/1655] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:35.407939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:35.409446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:35.416234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:35.557184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1892a83-db37-453a-ada5-0062b7403fa8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:35.561309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f7dba-19b1-4db0-aba1-b48dd5878d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:35.562054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f7dba-19b1-4db0-aba1-b48dd5878d79 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:35.562342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f7dba-19b1-4db0-aba1-b48dd5878d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:35.562617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f7dba-19b1-4db0-aba1-b48dd5878d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:35.573696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f7dba-19b1-4db0-aba1-b48dd5878d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:35.575422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f7dba-19b1-4db0-aba1-b48dd5878d79 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:35.597534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 832/1656] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:35.768107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45b58c-05de-402b-8c31-c28b8f12cada None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:35.768615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45b58c-05de-402b-8c31-c28b8f12cada None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:35.768894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45b58c-05de-402b-8c31-c28b8f12cada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:35.819869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ee45b58c-05de-402b-8c31-c28b8f12cada None None] MFA Rules not processed for user `97e53b295eb24d558023b8a120dad771`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:35.824163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ee45b58c-05de-402b-8c31-c28b8f12cada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:35.969121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f7dba-19b1-4db0-aba1-b48dd5878d79 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:35.969602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 825/1657] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:35.970689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b05f7dba-19b1-4db0-aba1-b48dd5878d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:36.181017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45b58c-05de-402b-8c31-c28b8f12cada None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:36.182866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ee45b58c-05de-402b-8c31-c28b8f12cada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:36.205114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f7dba-19b1-4db0-aba1-b48dd5878d79 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:36.210803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45b58c-05de-402b-8c31-c28b8f12cada None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:36.230964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3cf98-89cf-4749-bf30-752321269e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:36.232884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3cf98-89cf-4749-bf30-752321269e6d service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:36.233716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:36.234239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3cf98-89cf-4749-bf30-752321269e6d service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:36.234714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3cf98-89cf-4749-bf30-752321269e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:36.235826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:36.239345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:36.239902 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] PATH_INFO: `/v3/users/14ee3f3d50724574b17fa17c1b5e5a7e` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:36.242369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ee3f3d50724574b17fa17c1b5e5a7e)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:36.251415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:36.274907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3cf98-89cf-4749-bf30-752321269e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:36.282201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3cf98-89cf-4749-bf30-752321269e6d service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:36.325491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 833/1658] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:39:36.335518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3cf98-89cf-4749-bf30-752321269e6d service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:36.345672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fee3cf98-89cf-4749-bf30-752321269e6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:36.397132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3cf98-89cf-4749-bf30-752321269e6d service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:36.419081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:36.419972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:36.420307 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:36.420585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] PATH_INFO: `/v3/projects/925496c9825e4d55a7945f8bf5023a9d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:36.422725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] RBAC: Authorizing `identity:delete_project(project_id=925496c9825e4d55a7945f8bf5023a9d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:36.423845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: WARNING py.warnings [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:39:36.423845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: warnings.warn(msg) Jun 16 17:39:36.423845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: Jun 16 17:39:36.425106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:36.541061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ee3f3d50724574b17fa17c1b5e5a7e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.579002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:36.582020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ee3f3d50724574b17fa17c1b5e5a7e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.623675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925496c9825e4d55a7945f8bf5023a9d', 'request_id': 'req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.669127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925496c9825e4d55a7945f8bf5023a9d', 'request_id': 'req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.684029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ee3f3d50724574b17fa17c1b5e5a7e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.685897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ee3f3d50724574b17fa17c1b5e5a7e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.686985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9261d6a5-a0f0-40f3-b878-d6f4c1772792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ee3f3d50724574b17fa17c1b5e5a7e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.708508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925496c9825e4d55a7945f8bf5023a9d', 'request_id': 'req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.722337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 826/1659] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:39:36 2022] DELETE /identity/v3/users/14ee3f3d50724574b17fa17c1b5e5a7e => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:36.726772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437157a6-2d8a-4238-905b-15db34e4ec1e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:36.727764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437157a6-2d8a-4238-905b-15db34e4ec1e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:36.728385 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437157a6-2d8a-4238-905b-15db34e4ec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:36.760933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-437157a6-2d8a-4238-905b-15db34e4ec1e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:36.765672 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-437157a6-2d8a-4238-905b-15db34e4ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:36.823875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] The token cache is being invalidate because project 925496c9825e4d55a7945f8bf5023a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:39:36.826065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.828027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dc3ae1f5-74c2-4312-bee7-90505c4dcdac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:36.835647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 834/1660] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:39:36 2022] DELETE /identity/v3/projects/925496c9825e4d55a7945f8bf5023a9d => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:36.862002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40d40-397d-43cc-bd9c-cf127567e91b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:36.862647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40d40-397d-43cc-bd9c-cf127567e91b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:36.863347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40d40-397d-43cc-bd9c-cf127567e91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:36.919589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 827/1661] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:39:36.923942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a3f40d40-397d-43cc-bd9c-cf127567e91b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:36.925413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a3f40d40-397d-43cc-bd9c-cf127567e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:36.954447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 835/1662] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:36.957945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fec80-b84e-4abf-a750-cd4d96fdb1a5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:36.958528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fec80-b84e-4abf-a750-cd4d96fdb1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:36.958998 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fec80-b84e-4abf-a750-cd4d96fdb1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:36.996841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e52fec80-b84e-4abf-a750-cd4d96fdb1a5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:36.998479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e52fec80-b84e-4abf-a750-cd4d96fdb1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:37.044952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 828/1663] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:37.046504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40d40-397d-43cc-bd9c-cf127567e91b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.053890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fec80-b84e-4abf-a750-cd4d96fdb1a5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.058241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e52fec80-b84e-4abf-a750-cd4d96fdb1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:37.074027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40d40-397d-43cc-bd9c-cf127567e91b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.089846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886bad5-9138-42e4-9364-4572cc08497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.090708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886bad5-9138-42e4-9364-4572cc08497c admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.091534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886bad5-9138-42e4-9364-4572cc08497c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.091826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886bad5-9138-42e4-9364-4572cc08497c admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.093899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886bad5-9138-42e4-9364-4572cc08497c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:37.095142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886bad5-9138-42e4-9364-4572cc08497c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.097605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886bad5-9138-42e4-9364-4572cc08497c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.108747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:37.130846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 836/1664] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:37.135538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886bad5-9138-42e4-9364-4572cc08497c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.146839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886bad5-9138-42e4-9364-4572cc08497c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.167760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4c81-e03a-4b86-a7bc-23f6fb7098e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.168724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4c81-e03a-4b86-a7bc-23f6fb7098e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.169191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4c81-e03a-4b86-a7bc-23f6fb7098e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.169646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4c81-e03a-4b86-a7bc-23f6fb7098e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.170734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea4c81-e03a-4b86-a7bc-23f6fb7098e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.172878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea4c81-e03a-4b86-a7bc-23f6fb7098e5 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.242235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fec80-b84e-4abf-a750-cd4d96fdb1a5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.289890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cd9eb-d209-4847-aeca-5bc9522c2867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.294031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cd9eb-d209-4847-aeca-5bc9522c2867 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.295283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cd9eb-d209-4847-aeca-5bc9522c2867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.300732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cd9eb-d209-4847-aeca-5bc9522c2867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.316261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 837/1665] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:37 2022] POST /identity/v3/projects => generated 357 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:37.318021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4c81-e03a-4b86-a7bc-23f6fb7098e5 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.366579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cd9eb-d209-4847-aeca-5bc9522c2867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.368251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cd9eb-d209-4847-aeca-5bc9522c2867 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.392854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 829/1666] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:37.462578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4c81-e03a-4b86-a7bc-23f6fb7098e5 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.477183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6676a-d841-4bcd-aaf9-f878ea565424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.478170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6676a-d841-4bcd-aaf9-f878ea565424 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.478827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6676a-d841-4bcd-aaf9-f878ea565424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.482978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6676a-d841-4bcd-aaf9-f878ea565424 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.482978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6676a-d841-4bcd-aaf9-f878ea565424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.482978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6676a-d841-4bcd-aaf9-f878ea565424 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.625709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 838/1667] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:37 2022] POST /identity/v3/users => generated 279 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:39:37.626996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cd9eb-d209-4847-aeca-5bc9522c2867 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.640106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cd9eb-d209-4847-aeca-5bc9522c2867 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.664311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688e2df-7cdd-4d7b-8dbc-93f0f3ed3416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.665058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688e2df-7cdd-4d7b-8dbc-93f0f3ed3416 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.665341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688e2df-7cdd-4d7b-8dbc-93f0f3ed3416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.665620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688e2df-7cdd-4d7b-8dbc-93f0f3ed3416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.666356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688e2df-7cdd-4d7b-8dbc-93f0f3ed3416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.668165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688e2df-7cdd-4d7b-8dbc-93f0f3ed3416 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.697143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 830/1668] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:37.701311 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6676a-d841-4bcd-aaf9-f878ea565424 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.718830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6676a-d841-4bcd-aaf9-f878ea565424 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.721035 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82373906-316a-42ec-9ac6-6fb923bd5594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.721914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82373906-316a-42ec-9ac6-6fb923bd5594 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.722341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82373906-316a-42ec-9ac6-6fb923bd5594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.722755 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82373906-316a-42ec-9ac6-6fb923bd5594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.723684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82373906-316a-42ec-9ac6-6fb923bd5594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.725501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82373906-316a-42ec-9ac6-6fb923bd5594 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.738782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 839/1669] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:37.744357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688e2df-7cdd-4d7b-8dbc-93f0f3ed3416 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:37.756786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688e2df-7cdd-4d7b-8dbc-93f0f3ed3416 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:37.772119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fba4d0-5e5f-4e3c-a5c6-7a8551e4d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:37.773573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fba4d0-5e5f-4e3c-a5c6-7a8551e4d8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.774007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fba4d0-5e5f-4e3c-a5c6-7a8551e4d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.774624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fba4d0-5e5f-4e3c-a5c6-7a8551e4d8a3 admin admin] PATH_INFO: `/v3/projects/be8dec5ce948446987a8c88cca8e3127/users/b989465af99b439f96ce71fa17fa89a4/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.796665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fba4d0-5e5f-4e3c-a5c6-7a8551e4d8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8dec5ce948446987a8c88cca8e3127, user_id=b989465af99b439f96ce71fa17fa89a4, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:37.800142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fba4d0-5e5f-4e3c-a5c6-7a8551e4d8a3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:37.888680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 831/1670] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:37 2022] PUT /identity/v3/projects/be8dec5ce948446987a8c88cca8e3127/users/b989465af99b439f96ce71fa17fa89a4/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:37.892907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e5f48-2851-4ed5-b0f4-2f6a5ed83229 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:37.893460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e5f48-2851-4ed5-b0f4-2f6a5ed83229 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:37.893992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e5f48-2851-4ed5-b0f4-2f6a5ed83229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:37.982704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-5c4e5f48-2851-4ed5-b0f4-2f6a5ed83229 None None] MFA Rules not processed for user `b989465af99b439f96ce71fa17fa89a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:37.985275 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5c4e5f48-2851-4ed5-b0f4-2f6a5ed83229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:38.140406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312288d-d45e-4ddc-935e-a7909fc5ee99 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.149530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312288d-d45e-4ddc-935e-a7909fc5ee99 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.149530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312288d-d45e-4ddc-935e-a7909fc5ee99 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.149530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 832/1671] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:39:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 17:39:38.150044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 840/1672] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:37 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:38.150799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312288d-d45e-4ddc-935e-a7909fc5ee99 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.170599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31f79a-0a8c-4c09-a3c4-aa2f1da74d20 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.171210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31f79a-0a8c-4c09-a3c4-aa2f1da74d20 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.171635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31f79a-0a8c-4c09-a3c4-aa2f1da74d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.232736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-aa31f79a-0a8c-4c09-a3c4-aa2f1da74d20 None None] MFA Rules not processed for user `a2909d4015ac45fcaf6d1fc8e488aa44`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:38.249317 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-aa31f79a-0a8c-4c09-a3c4-aa2f1da74d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:38.311508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:38.362420 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312288d-d45e-4ddc-935e-a7909fc5ee99 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.376100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7259304-5e27-40be-b13d-33f88a7d2ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.376787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7259304-5e27-40be-b13d-33f88a7d2ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.377120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7259304-5e27-40be-b13d-33f88a7d2ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.377469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7259304-5e27-40be-b13d-33f88a7d2ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.382382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7259304-5e27-40be-b13d-33f88a7d2ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.386600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7259304-5e27-40be-b13d-33f88a7d2ca0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.453566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 841/1673] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:39:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:38.455443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31f79a-0a8c-4c09-a3c4-aa2f1da74d20 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.458078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-aa31f79a-0a8c-4c09-a3c4-aa2f1da74d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:38.491336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31f79a-0a8c-4c09-a3c4-aa2f1da74d20 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.499476 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.501456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.501742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.502079 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] PATH_INFO: `/v3/users/374fc5d4b4af4336b727d382b203ce31` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.504522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=374fc5d4b4af4336b727d382b203ce31)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.508533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.596123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 833/1674] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:38 2022] POST /identity/v3/projects => generated 357 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:39:38.596123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7259304-5e27-40be-b13d-33f88a7d2ca0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.597344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b7259304-5e27-40be-b13d-33f88a7d2ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:38.759595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7259304-5e27-40be-b13d-33f88a7d2ca0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.766137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0fb76-684c-4d7b-bd4f-5f755d4af2aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.767056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0fb76-684c-4d7b-bd4f-5f755d4af2aa service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.767976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0fb76-684c-4d7b-bd4f-5f755d4af2aa service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.768361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0fb76-684c-4d7b-bd4f-5f755d4af2aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.779639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0fb76-684c-4d7b-bd4f-5f755d4af2aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.784506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0fb76-684c-4d7b-bd4f-5f755d4af2aa service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:38.807026 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 834/1675] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:38.809096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0fb76-684c-4d7b-bd4f-5f755d4af2aa service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:38.855557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374fc5d4b4af4336b727d382b203ce31'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:38.925520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0fb76-684c-4d7b-bd4f-5f755d4af2aa service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:38.928844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374fc5d4b4af4336b727d382b203ce31'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:38.931907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6efc9b-ee11-4f2d-9033-d0cc6f73f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:38.933180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6efc9b-ee11-4f2d-9033-d0cc6f73f049 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:38.933896 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6efc9b-ee11-4f2d-9033-d0cc6f73f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:38.934364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6efc9b-ee11-4f2d-9033-d0cc6f73f049 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:38.935265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6efc9b-ee11-4f2d-9033-d0cc6f73f049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:38.937526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6efc9b-ee11-4f2d-9033-d0cc6f73f049 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:39.038925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374fc5d4b4af4336b727d382b203ce31'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:39.041080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374fc5d4b4af4336b727d382b203ce31'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:39.047211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374fc5d4b4af4336b727d382b203ce31'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:39.062206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 842/1676] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:39:38 2022] DELETE /identity/v3/users/374fc5d4b4af4336b727d382b203ce31 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:39.063469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:39.072013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:39.084824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 835/1677] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:38 2022] POST /identity/v3/users => generated 285 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:39.086419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00cc4-cf69-411e-80bc-a9021d1bbd75 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:39.086770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00cc4-cf69-411e-80bc-a9021d1bbd75 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:39.087737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00cc4-cf69-411e-80bc-a9021d1bbd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:39.159036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:39.192423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6df00cc4-cf69-411e-80bc-a9021d1bbd75 None None] MFA Rules not processed for user `65a3da0b77fd473584f7e356c05890a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:39.193808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6df00cc4-cf69-411e-80bc-a9021d1bbd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:39.302932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793e4d9-d075-4189-8897-e770941cf9a4 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:39.315750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:39.317558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:39.321143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:39.322118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] PATH_INFO: `/v3/projects/bc55d9264920409794a4ded43d258274` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:39.325694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc55d9264920409794a4ded43d258274)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:39.332333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:39.450704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 836/1678] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:39.451775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df00cc4-cf69-411e-80bc-a9021d1bbd75 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:39.454872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6df00cc4-cf69-411e-80bc-a9021d1bbd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:39.518855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df00cc4-cf69-411e-80bc-a9021d1bbd75 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:39.525703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e3454-65af-4137-a77b-299325efca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:39.526340 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e3454-65af-4137-a77b-299325efca8e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:39.526629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e3454-65af-4137-a77b-299325efca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:39.526914 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e3454-65af-4137-a77b-299325efca8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:39.527660 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e3454-65af-4137-a77b-299325efca8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:39.529782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e3454-65af-4137-a77b-299325efca8e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:39.566533 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 837/1679] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:39.567532 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e3454-65af-4137-a77b-299325efca8e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:39.580116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7c6e3454-65af-4137-a77b-299325efca8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:39.588066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc55d9264920409794a4ded43d258274', 'request_id': 'req-25e31572-5948-4868-9c0f-2ea4ef9a67fe'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:39.600960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e3454-65af-4137-a77b-299325efca8e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:39.601166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc55d9264920409794a4ded43d258274', 'request_id': 'req-25e31572-5948-4868-9c0f-2ea4ef9a67fe'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:39.616103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc55d9264920409794a4ded43d258274', 'request_id': 'req-25e31572-5948-4868-9c0f-2ea4ef9a67fe'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:39.729968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:39.732291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:39.732960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:39.733386 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] PATH_INFO: `/v3/projects/9676786323cb499bb6d6dfe90e6abc66` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:39.738699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9676786323cb499bb6d6dfe90e6abc66)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:39.744239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:39.752571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] The token cache is being invalidate because project bc55d9264920409794a4ded43d258274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:39:39.753128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:39.754842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:39.761346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 843/1680] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:39:39 2022] DELETE /identity/v3/projects/bc55d9264920409794a4ded43d258274 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:39.762568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:39.767042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:39.933446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9676786323cb499bb6d6dfe90e6abc66', 'request_id': 'req-d6c51c60-dd36-4b28-805e-3500c80fad50'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:39.934891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e31572-5948-4868-9c0f-2ea4ef9a67fe admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:39.942433 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9676786323cb499bb6d6dfe90e6abc66', 'request_id': 'req-d6c51c60-dd36-4b28-805e-3500c80fad50'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:40.077235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9676786323cb499bb6d6dfe90e6abc66', 'request_id': 'req-d6c51c60-dd36-4b28-805e-3500c80fad50'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:40.120600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] The token cache is being invalidate because project 9676786323cb499bb6d6dfe90e6abc66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:39:40.122308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:40.123539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:40.134842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 838/1681] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:39:39 2022] DELETE /identity/v3/projects/9676786323cb499bb6d6dfe90e6abc66 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:40.134842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:40.136643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7797d3-ff6c-4b62-84d3-b4863a2f8750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:40.137136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:40.138588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7797d3-ff6c-4b62-84d3-b4863a2f8750 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:40.138878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7797d3-ff6c-4b62-84d3-b4863a2f8750 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:40.139162 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7797d3-ff6c-4b62-84d3-b4863a2f8750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:40.144686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fb7797d3-ff6c-4b62-84d3-b4863a2f8750 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:40.254628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7797d3-ff6c-4b62-84d3-b4863a2f8750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:40.256766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7797d3-ff6c-4b62-84d3-b4863a2f8750 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:40.273044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 844/1682] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:40.275545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144727d-4549-4838-acf1-f6352ca4efa1 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:40.276004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144727d-4549-4838-acf1-f6352ca4efa1 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:40.276602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144727d-4549-4838-acf1-f6352ca4efa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:40.337545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-2144727d-4549-4838-acf1-f6352ca4efa1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:40.345794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-2144727d-4549-4838-acf1-f6352ca4efa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:40.374362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c51c60-dd36-4b28-805e-3500c80fad50 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:40.385835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 845/1683] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:40.387736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144727d-4549-4838-acf1-f6352ca4efa1 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:40.395733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-2144727d-4549-4838-acf1-f6352ca4efa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:40.398259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f6f50-1fed-43fe-ad00-5c8a773d2b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:40.402788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f6f50-1fed-43fe-ad00-5c8a773d2b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:40.406173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f6f50-1fed-43fe-ad00-5c8a773d2b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:40.408242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f6f50-1fed-43fe-ad00-5c8a773d2b3f admin admin] PATH_INFO: `/v3/projects/1a8fa33d8fd341a78f24940337cabb6c/users/afe2673b561340c9825c3ab5bb74551f/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:40.448713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144727d-4549-4838-acf1-f6352ca4efa1 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:40.471679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:40.479919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:40.481718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:40.483278 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] PATH_INFO: `/v3/users/5990681be49f4a0a8e98cf4436c45074` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:40.486924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5990681be49f4a0a8e98cf4436c45074)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:40.489358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f6f50-1fed-43fe-ad00-5c8a773d2b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8fa33d8fd341a78f24940337cabb6c, user_id=afe2673b561340c9825c3ab5bb74551f, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:40.494827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:40.505612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f6f50-1fed-43fe-ad00-5c8a773d2b3f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:40.677527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 839/1684] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:40 2022] PUT /identity/v3/projects/1a8fa33d8fd341a78f24940337cabb6c/users/afe2673b561340c9825c3ab5bb74551f/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:40.684633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d318-c9e6-4901-afa3-212d52facfdd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:40.684816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d318-c9e6-4901-afa3-212d52facfdd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:40.685174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d318-c9e6-4901-afa3-212d52facfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:40.780055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7847d318-c9e6-4901-afa3-212d52facfdd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:40.786211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7847d318-c9e6-4901-afa3-212d52facfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:40.876011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5990681be49f4a0a8e98cf4436c45074'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:40.950415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5990681be49f4a0a8e98cf4436c45074'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:40.976464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 840/1685] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:40.981150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847d318-c9e6-4901-afa3-212d52facfdd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:41.011306 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847d318-c9e6-4901-afa3-212d52facfdd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:41.034316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10c3d2-9a0c-483c-8cd5-32c5907336b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:41.035333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10c3d2-9a0c-483c-8cd5-32c5907336b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:41.035765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10c3d2-9a0c-483c-8cd5-32c5907336b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:41.038025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10c3d2-9a0c-483c-8cd5-32c5907336b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:41.039334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10c3d2-9a0c-483c-8cd5-32c5907336b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:41.043015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10c3d2-9a0c-483c-8cd5-32c5907336b3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:41.058484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5990681be49f4a0a8e98cf4436c45074'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:41.060053 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5990681be49f4a0a8e98cf4436c45074'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:41.060999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5990681be49f4a0a8e98cf4436c45074'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:41.076156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 841/1686] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:41.078219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10c3d2-9a0c-483c-8cd5-32c5907336b3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:41.085589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-eb10c3d2-9a0c-483c-8cd5-32c5907336b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:41.096197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 846/1687] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:39:40 2022] DELETE /identity/v3/users/5990681be49f4a0a8e98cf4436c45074 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:41.098801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:41.109233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:41.128222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10c3d2-9a0c-483c-8cd5-32c5907336b3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:41.261623 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c20b0-8171-470d-97d4-48ccb331cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:41.263762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c20b0-8171-470d-97d4-48ccb331cb8c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:41.264521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c20b0-8171-470d-97d4-48ccb331cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:41.272250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c20b0-8171-470d-97d4-48ccb331cb8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:41.272250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c20b0-8171-470d-97d4-48ccb331cb8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:41.272250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c20b0-8171-470d-97d4-48ccb331cb8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:41.276061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c20b0-8171-470d-97d4-48ccb331cb8c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:41.287495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758a570-b43e-428a-96c2-067d948562ab admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:41.294781 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:41.297578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:41.299045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:41.306506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:41.306506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] PATH_INFO: `/v3/projects/85bdc85835c24e5ebd05494d6abe4845` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:41.306506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bdc85835c24e5ebd05494d6abe4845)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:41.306506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:41.312521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 842/1688] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:41.319357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c20b0-8171-470d-97d4-48ccb331cb8c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:41.326930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-788c20b0-8171-470d-97d4-48ccb331cb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:41.372607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:41.385483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c20b0-8171-470d-97d4-48ccb331cb8c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:41.406842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fe393-4310-44ef-b164-82a155eb9b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:41.410257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe393-4310-44ef-b164-82a155eb9b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:41.410557 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe393-4310-44ef-b164-82a155eb9b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:41.415828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe393-4310-44ef-b164-82a155eb9b20 admin admin] PATH_INFO: `/v3/projects/1a8fa33d8fd341a78f24940337cabb6c/users/afe2673b561340c9825c3ab5bb74551f/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:41.422756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fe393-4310-44ef-b164-82a155eb9b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8fa33d8fd341a78f24940337cabb6c, user_id=afe2673b561340c9825c3ab5bb74551f, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:41.430734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fe393-4310-44ef-b164-82a155eb9b20 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:41.479210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 843/1689] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:41 2022] PUT /identity/v3/projects/1a8fa33d8fd341a78f24940337cabb6c/users/afe2673b561340c9825c3ab5bb74551f/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:41.485669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fe393-4310-44ef-b164-82a155eb9b20 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:41.524940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bdc85835c24e5ebd05494d6abe4845', 'request_id': 'req-61a68923-f1b1-403b-83c0-22ce3b062ff9'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:41.548913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bdc85835c24e5ebd05494d6abe4845', 'request_id': 'req-61a68923-f1b1-403b-83c0-22ce3b062ff9'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:41.584967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bdc85835c24e5ebd05494d6abe4845', 'request_id': 'req-61a68923-f1b1-403b-83c0-22ce3b062ff9'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:41.653723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fe393-4310-44ef-b164-82a155eb9b20 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:41.706182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] The token cache is being invalidate because project 85bdc85835c24e5ebd05494d6abe4845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:39:41.706482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:41.708242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-61a68923-f1b1-403b-83c0-22ce3b062ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:41.710733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 847/1690] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:39:41 2022] DELETE /identity/v3/projects/85bdc85835c24e5ebd05494d6abe4845 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:41.712760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19659a3-e6a7-4755-9e28-3ea0d904ce43 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:41.713205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19659a3-e6a7-4755-9e28-3ea0d904ce43 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:41.713492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19659a3-e6a7-4755-9e28-3ea0d904ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:41.799549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d19659a3-e6a7-4755-9e28-3ea0d904ce43 None None] MFA Rules not processed for user `afe2673b561340c9825c3ab5bb74551f`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:41.800837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d19659a3-e6a7-4755-9e28-3ea0d904ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:41.862979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de02e79-f826-4024-bda0-27c85d3c2257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:41.864192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02e79-f826-4024-bda0-27c85d3c2257 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:41.864346 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02e79-f826-4024-bda0-27c85d3c2257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:41.865513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02e79-f826-4024-bda0-27c85d3c2257 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:41.865625 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de02e79-f826-4024-bda0-27c85d3c2257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:41.867969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de02e79-f826-4024-bda0-27c85d3c2257 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:41.957066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 848/1691] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:41 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:41.957993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19659a3-e6a7-4755-9e28-3ea0d904ce43 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:41.969053 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d19659a3-e6a7-4755-9e28-3ea0d904ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:41.990633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19659a3-e6a7-4755-9e28-3ea0d904ce43 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:42.011899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:42.015357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:42.017157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:42.017509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] PATH_INFO: `/v3/users/8ed1acc1f1d149acbdd6c8b2bc1ff125` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:42.021324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed1acc1f1d149acbdd6c8b2bc1ff125)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:42.024128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:42.065718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 844/1692] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:41 2022] POST /identity/v3/projects => generated 367 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:42.070201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de02e79-f826-4024-bda0-27c85d3c2257 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:42.077708 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1de02e79-f826-4024-bda0-27c85d3c2257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:42.264329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de02e79-f826-4024-bda0-27c85d3c2257 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:42.274894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe0f44-090a-4d22-acbb-2bdb4931c7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:42.276005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe0f44-090a-4d22-acbb-2bdb4931c7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:42.276481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe0f44-090a-4d22-acbb-2bdb4931c7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:42.277378 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe0f44-090a-4d22-acbb-2bdb4931c7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:42.324481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed1acc1f1d149acbdd6c8b2bc1ff125'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:42.356782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed1acc1f1d149acbdd6c8b2bc1ff125'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:42.414065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed1acc1f1d149acbdd6c8b2bc1ff125'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:42.414714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed1acc1f1d149acbdd6c8b2bc1ff125'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:42.415826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed1acc1f1d149acbdd6c8b2bc1ff125'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:42.442778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 849/1693] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:39:41 2022] DELETE /identity/v3/users/8ed1acc1f1d149acbdd6c8b2bc1ff125 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:42.443662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:42.449529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:42.451356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe0f44-090a-4d22-acbb-2bdb4931c7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:42.454222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe0f44-090a-4d22-acbb-2bdb4931c7f4 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:42.479404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 845/1694] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:42 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:42.659223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daaa36-a77c-4e2c-8003-846efa9bdd53 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:42.669897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dfd3e-d140-4249-8ce9-7a0a903b3ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:42.671497 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dfd3e-d140-4249-8ce9-7a0a903b3ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:42.671497 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dfd3e-d140-4249-8ce9-7a0a903b3ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:42.671497 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dfd3e-d140-4249-8ce9-7a0a903b3ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:42.674321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dfd3e-d140-4249-8ce9-7a0a903b3ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:42.679849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dfd3e-d140-4249-8ce9-7a0a903b3ad6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:42.726141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2b14-29f1-47b3-aa5d-dbbe345ef59c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:42.728204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2b14-29f1-47b3-aa5d-dbbe345ef59c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:42.728703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2b14-29f1-47b3-aa5d-dbbe345ef59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:42.794475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9c5a2b14-29f1-47b3-aa5d-dbbe345ef59c None None] MFA Rules not processed for user `f814a06f54894fa2992d3ba3be21b4db`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:42.797339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9c5a2b14-29f1-47b3-aa5d-dbbe345ef59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:42.825496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:42.834528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 850/1695] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:42 2022] POST /identity/v3/users => generated 284 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:42.836304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dfd3e-d140-4249-8ce9-7a0a903b3ad6 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:42.839684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7b5dfd3e-d140-4249-8ce9-7a0a903b3ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:42.965527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dfd3e-d140-4249-8ce9-7a0a903b3ad6 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:42.978498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 846/1696] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:39:42.978498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2b14-29f1-47b3-aa5d-dbbe345ef59c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:42.978823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136af92d-e9ee-4a62-984f-f30002cbf937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:42.978823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136af92d-e9ee-4a62-984f-f30002cbf937 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:42.978823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136af92d-e9ee-4a62-984f-f30002cbf937 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:42.978823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136af92d-e9ee-4a62-984f-f30002cbf937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:42.985703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-136af92d-e9ee-4a62-984f-f30002cbf937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:43.003233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2b14-29f1-47b3-aa5d-dbbe345ef59c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:43.019620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba7d56-ceff-4559-91f0-510e29b6f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:43.020374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba7d56-ceff-4559-91f0-510e29b6f945 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:43.020665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba7d56-ceff-4559-91f0-510e29b6f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:43.020948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba7d56-ceff-4559-91f0-510e29b6f945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:43.022361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba7d56-ceff-4559-91f0-510e29b6f945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:43.024899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba7d56-ceff-4559-91f0-510e29b6f945 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:43.047666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 847/1697] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:43.049364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4eaf5-18df-4c10-87ce-c30888ee20ea None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:43.049661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4eaf5-18df-4c10-87ce-c30888ee20ea None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:43.051077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4eaf5-18df-4c10-87ce-c30888ee20ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:43.097190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0ac4eaf5-18df-4c10-87ce-c30888ee20ea None None] MFA Rules not processed for user `f814a06f54894fa2992d3ba3be21b4db`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:43.101935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0ac4eaf5-18df-4c10-87ce-c30888ee20ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:43.151477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 848/1698] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:43.151477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4eaf5-18df-4c10-87ce-c30888ee20ea None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:43.216573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4eaf5-18df-4c10-87ce-c30888ee20ea None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:43.227087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dbb94-61c4-4a28-a577-38cabf71234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:43.227921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dbb94-61c4-4a28-a577-38cabf71234b admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:43.228310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dbb94-61c4-4a28-a577-38cabf71234b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:43.228595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dbb94-61c4-4a28-a577-38cabf71234b admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:43.229382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dbb94-61c4-4a28-a577-38cabf71234b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:43.231072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dbb94-61c4-4a28-a577-38cabf71234b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:43.244144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 849/1699] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:43.245578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5f03-3259-4f3f-af5e-f241067c809d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:43.246497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5f03-3259-4f3f-af5e-f241067c809d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:43.246789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5f03-3259-4f3f-af5e-f241067c809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:43.269550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136af92d-e9ee-4a62-984f-f30002cbf937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:43.271173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136af92d-e9ee-4a62-984f-f30002cbf937 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:43.292545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 851/1700] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:42 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:43.295748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136af92d-e9ee-4a62-984f-f30002cbf937 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:43.296947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-87ff5f03-3259-4f3f-af5e-f241067c809d None None] MFA Rules not processed for user `28c031d2975a45beba19a6dbfaa691c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:43.298318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-87ff5f03-3259-4f3f-af5e-f241067c809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:43.304255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-136af92d-e9ee-4a62-984f-f30002cbf937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:43.334998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136af92d-e9ee-4a62-984f-f30002cbf937 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:43.342951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:43.344571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:43.345154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:43.345449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] PATH_INFO: `/v3/projects/0e24a8064ceb4339a2a8cf0e8c35366c` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:43.347875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e24a8064ceb4339a2a8cf0e8c35366c)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:43.350716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:43.456091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 850/1701] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:43.457263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff5f03-3259-4f3f-af5e-f241067c809d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:43.462116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-87ff5f03-3259-4f3f-af5e-f241067c809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:43.535577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e24a8064ceb4339a2a8cf0e8c35366c', 'request_id': 'req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:43.549670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e24a8064ceb4339a2a8cf0e8c35366c', 'request_id': 'req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:43.563196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e24a8064ceb4339a2a8cf0e8c35366c', 'request_id': 'req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:43.666118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff5f03-3259-4f3f-af5e-f241067c809d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:43.739650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:43.795555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b94da-7993-490a-bb30-9856e834c213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:43.796294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b94da-7993-490a-bb30-9856e834c213 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:43.796580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b94da-7993-490a-bb30-9856e834c213 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:43.796862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b94da-7993-490a-bb30-9856e834c213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:43.798375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] The token cache is being invalidate because project 0e24a8064ceb4339a2a8cf0e8c35366c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:39:43.800939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:43.803471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:43.809152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 852/1702] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:39:43 2022] DELETE /identity/v3/projects/0e24a8064ceb4339a2a8cf0e8c35366c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:43.809152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:43.814927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:43.871269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b94da-7993-490a-bb30-9856e834c213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:43.872928 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b94da-7993-490a-bb30-9856e834c213 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:43.884567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 851/1703] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:43.885600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b94da-7993-490a-bb30-9856e834c213 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:43.887069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e21b94da-7993-490a-bb30-9856e834c213 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:43.993038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b94da-7993-490a-bb30-9856e834c213 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:44.003228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:44.006007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:44.006651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:44.006942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] PATH_INFO: `/v3/projects/bd72c163467d4b05a6e9e8901ec2bf73` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:44.011369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd72c163467d4b05a6e9e8901ec2bf73)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:44.017354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:44.041834 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f109ce3-ee62-46b1-b69c-bb3362d2fc41 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:44.062805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641649c-ffe1-46dc-a620-bc653bc22927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:44.064285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641649c-ffe1-46dc-a620-bc653bc22927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:44.065863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641649c-ffe1-46dc-a620-bc653bc22927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:44.066453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641649c-ffe1-46dc-a620-bc653bc22927 admin admin] PATH_INFO: `/v3/projects/49d78edbadc04ffeb799641933c20923/users/19aef2143015486ea920cf486bbe3ba2/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:44.107654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641649c-ffe1-46dc-a620-bc653bc22927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d78edbadc04ffeb799641933c20923, user_id=19aef2143015486ea920cf486bbe3ba2, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:44.111509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641649c-ffe1-46dc-a620-bc653bc22927 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:44.198262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 853/1704] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:43 2022] PUT /identity/v3/projects/49d78edbadc04ffeb799641933c20923/users/19aef2143015486ea920cf486bbe3ba2/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:44.203456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eaa38-beac-4d86-ae15-c0476683b5c4 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:44.203803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eaa38-beac-4d86-ae15-c0476683b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:44.205874 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eaa38-beac-4d86-ae15-c0476683b5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:44.303869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd72c163467d4b05a6e9e8901ec2bf73', 'request_id': 'req-1e6d9246-befe-41ba-8b3f-d17355d9d11c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:44.312525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd72c163467d4b05a6e9e8901ec2bf73', 'request_id': 'req-1e6d9246-befe-41ba-8b3f-d17355d9d11c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:44.316528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-172eaa38-beac-4d86-ae15-c0476683b5c4 None None] MFA Rules not processed for user `28c031d2975a45beba19a6dbfaa691c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:44.317806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-172eaa38-beac-4d86-ae15-c0476683b5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:44.432062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd72c163467d4b05a6e9e8901ec2bf73', 'request_id': 'req-1e6d9246-befe-41ba-8b3f-d17355d9d11c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:44.454617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] The token cache is being invalidate because project bd72c163467d4b05a6e9e8901ec2bf73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:39:44.455017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:44.456983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1e6d9246-befe-41ba-8b3f-d17355d9d11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:39:44.478509 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 852/1705] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:39:43 2022] DELETE /identity/v3/projects/bd72c163467d4b05a6e9e8901ec2bf73 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:44.480249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00dbfa-2e9a-4f42-bac0-e25bd5eeed09 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:44.484727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00dbfa-2e9a-4f42-bac0-e25bd5eeed09 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:44.485074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00dbfa-2e9a-4f42-bac0-e25bd5eeed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:44.520753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 854/1706] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:44.527341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c115d-5cf2-4298-8099-5bf23d6fcee0 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:44.527625 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c115d-5cf2-4298-8099-5bf23d6fcee0 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:44.529333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c115d-5cf2-4298-8099-5bf23d6fcee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:44.583325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3d00dbfa-2e9a-4f42-bac0-e25bd5eeed09 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:44.584865 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3d00dbfa-2e9a-4f42-bac0-e25bd5eeed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:44.590676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-de3c115d-5cf2-4298-8099-5bf23d6fcee0 None None] MFA Rules not processed for user `97e53b295eb24d558023b8a120dad771`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:44.591803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-de3c115d-5cf2-4298-8099-5bf23d6fcee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:44.778199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 855/1707] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:44.780962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bddaa9-78aa-4d88-9733-8934c5356050 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:44.781264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bddaa9-78aa-4d88-9733-8934c5356050 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:44.782886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bddaa9-78aa-4d88-9733-8934c5356050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:44.796291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 853/1708] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:44.798235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7bedb-049f-4184-a2c5-e2d1bbabbe72 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:44.798511 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7bedb-049f-4184-a2c5-e2d1bbabbe72 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:44.798787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7bedb-049f-4184-a2c5-e2d1bbabbe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:44.864539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-64b7bedb-049f-4184-a2c5-e2d1bbabbe72 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:44.864719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d0bddaa9-78aa-4d88-9733-8934c5356050 None None] MFA Rules not processed for user `19aef2143015486ea920cf486bbe3ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:44.866230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d0bddaa9-78aa-4d88-9733-8934c5356050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:44.867299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-64b7bedb-049f-4184-a2c5-e2d1bbabbe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:44.912085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 854/1709] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:44.917286 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7bedb-049f-4184-a2c5-e2d1bbabbe72 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:44.924408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-64b7bedb-049f-4184-a2c5-e2d1bbabbe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:45.153132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 856/1710] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:45.157261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97f0c-873c-469d-9696-e888e40a8c52 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:45.157571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97f0c-873c-469d-9696-e888e40a8c52 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:45.158263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97f0c-873c-469d-9696-e888e40a8c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:45.173300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7bedb-049f-4184-a2c5-e2d1bbabbe72 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:45.182657 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204227b4-df3f-47e0-b678-0f2dfc4a9c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:45.184629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204227b4-df3f-47e0-b678-0f2dfc4a9c69 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:45.185073 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204227b4-df3f-47e0-b678-0f2dfc4a9c69 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:45.185938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204227b4-df3f-47e0-b678-0f2dfc4a9c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:45.191126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-204227b4-df3f-47e0-b678-0f2dfc4a9c69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:45.223281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-0dd97f0c-873c-469d-9696-e888e40a8c52 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:45.224578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0dd97f0c-873c-469d-9696-e888e40a8c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:45.247085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204227b4-df3f-47e0-b678-0f2dfc4a9c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:45.252601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 857/1711] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:45.252601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc760-338e-4cb6-984b-677ae1572c76 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:45.252601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc760-338e-4cb6-984b-677ae1572c76 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:45.252601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc760-338e-4cb6-984b-677ae1572c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:45.253223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204227b4-df3f-47e0-b678-0f2dfc4a9c69 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:45.276871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:45.287299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-c0cdc760-338e-4cb6-984b-677ae1572c76 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:45.290975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c0cdc760-338e-4cb6-984b-677ae1572c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:45.296897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 855/1712] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:45.299144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204227b4-df3f-47e0-b678-0f2dfc4a9c69 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:45.301815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-204227b4-df3f-47e0-b678-0f2dfc4a9c69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:45.331751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 858/1713] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:45.339122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae43c14-2ca0-41e3-9cd7-bd6434b6e5f2 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:45.339478 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae43c14-2ca0-41e3-9cd7-bd6434b6e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:45.340917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae43c14-2ca0-41e3-9cd7-bd6434b6e5f2 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:45.343577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 859/1714] 10.222.0.77 () {54 vars in 912 bytes} [Thu Jun 16 17:39:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:39:45.344420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae43c14-2ca0-41e3-9cd7-bd6434b6e5f2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:45.384785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae43c14-2ca0-41e3-9cd7-bd6434b6e5f2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:45.394272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db113c-bca1-4d99-bbac-49c540554f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:45.395792 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db113c-bca1-4d99-bbac-49c540554f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:45.396097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db113c-bca1-4d99-bbac-49c540554f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:45.396382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db113c-bca1-4d99-bbac-49c540554f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:45.401014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db113c-bca1-4d99-bbac-49c540554f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:45.401343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db113c-bca1-4d99-bbac-49c540554f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:45.406533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db113c-bca1-4d99-bbac-49c540554f72 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:45.445654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 860/1715] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:45.446705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db113c-bca1-4d99-bbac-49c540554f72 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:45.458135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db113c-bca1-4d99-bbac-49c540554f72 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:45.467685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204227b4-df3f-47e0-b678-0f2dfc4a9c69 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:45.469393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f4e04-ce4b-4ca3-a9d5-5e6459d53e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:45.470384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4e04-ce4b-4ca3-a9d5-5e6459d53e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:45.470745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4e04-ce4b-4ca3-a9d5-5e6459d53e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:45.471093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4e04-ce4b-4ca3-a9d5-5e6459d53e9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:45.471943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f4e04-ce4b-4ca3-a9d5-5e6459d53e9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:39:45.472347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f4e04-ce4b-4ca3-a9d5-5e6459d53e9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:45.474250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f4e04-ce4b-4ca3-a9d5-5e6459d53e9f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:45.483305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:45.483529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6692b6-0282-4856-83ec-5528b8a5eaeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:45.484056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6692b6-0282-4856-83ec-5528b8a5eaeb service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:45.484382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6692b6-0282-4856-83ec-5528b8a5eaeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:45.484664 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6692b6-0282-4856-83ec-5528b8a5eaeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:45.521925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 861/1716] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:39:45.523885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064125d9-c1c7-4f6c-b435-08b8ffb7ebdb None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:45.525437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064125d9-c1c7-4f6c-b435-08b8ffb7ebdb None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:45.526114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064125d9-c1c7-4f6c-b435-08b8ffb7ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:45.539615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6692b6-0282-4856-83ec-5528b8a5eaeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:45.541329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6692b6-0282-4856-83ec-5528b8a5eaeb service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:45.576305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 856/1717] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:45.576305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6692b6-0282-4856-83ec-5528b8a5eaeb service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:45.602174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-064125d9-c1c7-4f6c-b435-08b8ffb7ebdb None None] MFA Rules not processed for user `19ce01cdbd8d4ac9bb126a6814f2d13b`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:45.604330 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-064125d9-c1c7-4f6c-b435-08b8ffb7ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:45.609893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6692b6-0282-4856-83ec-5528b8a5eaeb service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:45.625188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f6c4-f2b3-4781-aa21-ce596396eff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:45.625927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f6c4-f2b3-4781-aa21-ce596396eff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:45.626212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f6c4-f2b3-4781-aa21-ce596396eff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:45.626490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f6c4-f2b3-4781-aa21-ce596396eff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:45.627482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1f6c4-f2b3-4781-aa21-ce596396eff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:45.631963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1f6c4-f2b3-4781-aa21-ce596396eff0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:45.747644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 862/1718] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:39:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:45.748775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064125d9-c1c7-4f6c-b435-08b8ffb7ebdb None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:45.780896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064125d9-c1c7-4f6c-b435-08b8ffb7ebdb None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:45.789324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 857/1719] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:45 2022] POST /identity/v3/projects => generated 409 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:45.790675 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f6c4-f2b3-4781-aa21-ce596396eff0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:45.799348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457c20f-7736-4c56-9508-0e71974b97be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:45.800781 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457c20f-7736-4c56-9508-0e71974b97be admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:45.803239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457c20f-7736-4c56-9508-0e71974b97be admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:45.806226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457c20f-7736-4c56-9508-0e71974b97be admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:45.807632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457c20f-7736-4c56-9508-0e71974b97be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:45.810861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457c20f-7736-4c56-9508-0e71974b97be admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:45.963000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 863/1720] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:45 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:45.969311 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457c20f-7736-4c56-9508-0e71974b97be admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:46.012190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f6c4-f2b3-4781-aa21-ce596396eff0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:46.169688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94cf0-4ee3-43fc-84bd-fd5ebb7e0ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:46.171202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94cf0-4ee3-43fc-84bd-fd5ebb7e0ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.171202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94cf0-4ee3-43fc-84bd-fd5ebb7e0ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.171202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94cf0-4ee3-43fc-84bd-fd5ebb7e0ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.171632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f94cf0-4ee3-43fc-84bd-fd5ebb7e0ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:46.177493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f94cf0-4ee3-43fc-84bd-fd5ebb7e0ef2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:46.185190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457c20f-7736-4c56-9508-0e71974b97be admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:46.206435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17951d3d-e149-463e-a3b4-321c82b5546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:46.208261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951d3d-e149-463e-a3b4-321c82b5546f admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.208261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951d3d-e149-463e-a3b4-321c82b5546f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.208261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951d3d-e149-463e-a3b4-321c82b5546f admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.216610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17951d3d-e149-463e-a3b4-321c82b5546f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:46.216696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:46.218969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17951d3d-e149-463e-a3b4-321c82b5546f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:46.344729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 858/1721] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:45 2022] POST /identity/v3/users => generated 305 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:46.345768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94cf0-4ee3-43fc-84bd-fd5ebb7e0ef2 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:46.347898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-17f94cf0-4ee3-43fc-84bd-fd5ebb7e0ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:46.406051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 864/1722] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:45 2022] POST /identity/v3/users => generated 282 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:46.407179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889cc6-453c-43e7-9fb8-06e221029628 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.407690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889cc6-453c-43e7-9fb8-06e221029628 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.409129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889cc6-453c-43e7-9fb8-06e221029628 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.418205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 865/1723] 10.222.0.77 () {54 vars in 912 bytes} [Thu Jun 16 17:39:46 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:39:46.419307 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42889cc6-453c-43e7-9fb8-06e221029628 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:46.439545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42889cc6-453c-43e7-9fb8-06e221029628 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:46.453372 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd94d4a-1026-4858-a585-718012b27eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:46.454551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94d4a-1026-4858-a585-718012b27eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.454955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94d4a-1026-4858-a585-718012b27eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.467117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94d4a-1026-4858-a585-718012b27eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.468503 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd94d4a-1026-4858-a585-718012b27eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:46.471794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd94d4a-1026-4858-a585-718012b27eeb admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:46.492034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 866/1724] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:46.492034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd94d4a-1026-4858-a585-718012b27eeb admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:46.492345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94cf0-4ee3-43fc-84bd-fd5ebb7e0ef2 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:46.502620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536fbcc-f206-4e63-8bee-0dfa72b679aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:46.503164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536fbcc-f206-4e63-8bee-0dfa72b679aa service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.507524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536fbcc-f206-4e63-8bee-0dfa72b679aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.507524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536fbcc-f206-4e63-8bee-0dfa72b679aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.508044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd94d4a-1026-4858-a585-718012b27eeb admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:46.513303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536fbcc-f206-4e63-8bee-0dfa72b679aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:46.515618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536fbcc-f206-4e63-8bee-0dfa72b679aa service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:46.517725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca14a28-11fa-4211-8823-610e62e9da3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:46.518876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14a28-11fa-4211-8823-610e62e9da3e admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.519231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14a28-11fa-4211-8823-610e62e9da3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.519635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14a28-11fa-4211-8823-610e62e9da3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.520497 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca14a28-11fa-4211-8823-610e62e9da3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:46.523693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca14a28-11fa-4211-8823-610e62e9da3e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:46.545976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 867/1725] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:46.545976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99228d12-eb95-45ca-9f43-b18949f71b05 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.545976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99228d12-eb95-45ca-9f43-b18949f71b05 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.545976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99228d12-eb95-45ca-9f43-b18949f71b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.552869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 859/1726] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:46.554475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536fbcc-f206-4e63-8bee-0dfa72b679aa service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:46.584348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-99228d12-eb95-45ca-9f43-b18949f71b05 None None] MFA Rules not processed for user `19ce01cdbd8d4ac9bb126a6814f2d13b`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:46.586029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-99228d12-eb95-45ca-9f43-b18949f71b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:46.595114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 868/1727] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:39:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:46.596991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99228d12-eb95-45ca-9f43-b18949f71b05 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:46.610791 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536fbcc-f206-4e63-8bee-0dfa72b679aa service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:46.612537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99228d12-eb95-45ca-9f43-b18949f71b05 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:46.628056 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161f3d-cdbe-4475-a878-7597ea42a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:46.631256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161f3d-cdbe-4475-a878-7597ea42a5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.631962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161f3d-cdbe-4475-a878-7597ea42a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.634564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161f3d-cdbe-4475-a878-7597ea42a5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.635649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76161f3d-cdbe-4475-a878-7597ea42a5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:46.637621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76161f3d-cdbe-4475-a878-7597ea42a5d9 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:46.638488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52deb11-301a-497f-b7aa-025fa6ed6405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:46.639518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52deb11-301a-497f-b7aa-025fa6ed6405 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.640251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52deb11-301a-497f-b7aa-025fa6ed6405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.640737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52deb11-301a-497f-b7aa-025fa6ed6405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.641728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52deb11-301a-497f-b7aa-025fa6ed6405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:46.644140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52deb11-301a-497f-b7aa-025fa6ed6405 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:46.659667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 869/1728] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:46.660914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161f3d-cdbe-4475-a878-7597ea42a5d9 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:46.666334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 860/1729] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:46.667239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52deb11-301a-497f-b7aa-025fa6ed6405 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:46.684014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161f3d-cdbe-4475-a878-7597ea42a5d9 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:46.687230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52deb11-301a-497f-b7aa-025fa6ed6405 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:46.700473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c9887-a748-4a14-9150-32d5f7ddda48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:46.701936 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c9887-a748-4a14-9150-32d5f7ddda48 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.702268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35a8ac-b710-4a64-bb24-444c1b8343a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:46.702775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c9887-a748-4a14-9150-32d5f7ddda48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.703156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c9887-a748-4a14-9150-32d5f7ddda48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.703888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35a8ac-b710-4a64-bb24-444c1b8343a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.704232 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35a8ac-b710-4a64-bb24-444c1b8343a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.704573 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35a8ac-b710-4a64-bb24-444c1b8343a6 admin admin] PATH_INFO: `/v3/projects/dc1a4b7738854584aa90437320befbd5/users/0dcd91485edd48b2ae7b4c40376473eb/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.714693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c9887-a748-4a14-9150-32d5f7ddda48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:46.717064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c9887-a748-4a14-9150-32d5f7ddda48 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:46.729240 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35a8ac-b710-4a64-bb24-444c1b8343a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1a4b7738854584aa90437320befbd5, user_id=0dcd91485edd48b2ae7b4c40376473eb, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:46.730636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 861/1730] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:39:46.731696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c9887-a748-4a14-9150-32d5f7ddda48 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:46.733806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35a8ac-b710-4a64-bb24-444c1b8343a6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:46.765174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c9887-a748-4a14-9150-32d5f7ddda48 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:46.781236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c526ef-763b-40a4-943c-2666ab71378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:46.783248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c526ef-763b-40a4-943c-2666ab71378a admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.784333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c526ef-763b-40a4-943c-2666ab71378a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.785018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c526ef-763b-40a4-943c-2666ab71378a admin admin] PATH_INFO: `/v3/projects/be8ff8f13e214faa85f5fe78b1377328/users/2e62ee26eac94ecbb67f005fd347ccbb/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.813416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c526ef-763b-40a4-943c-2666ab71378a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8ff8f13e214faa85f5fe78b1377328, user_id=2e62ee26eac94ecbb67f005fd347ccbb, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:46.816853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c526ef-763b-40a4-943c-2666ab71378a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:46.835723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 870/1731] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:46 2022] PUT /identity/v3/projects/dc1a4b7738854584aa90437320befbd5/users/0dcd91485edd48b2ae7b4c40376473eb/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:46.838210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4028fa-73ab-43bb-bf0a-6737e02fbd6b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.838507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4028fa-73ab-43bb-bf0a-6737e02fbd6b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.838793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4028fa-73ab-43bb-bf0a-6737e02fbd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.859862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9f4028fa-73ab-43bb-bf0a-6737e02fbd6b None None] MFA Rules not processed for user `65a3da0b77fd473584f7e356c05890a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:46.871638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9f4028fa-73ab-43bb-bf0a-6737e02fbd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:46.938383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 862/1732] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:46 2022] PUT /identity/v3/projects/be8ff8f13e214faa85f5fe78b1377328/users/2e62ee26eac94ecbb67f005fd347ccbb/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:46.940301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03efca-b419-4bca-9e9e-cec4769575bf None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.941878 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03efca-b419-4bca-9e9e-cec4769575bf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.942285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03efca-b419-4bca-9e9e-cec4769575bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:46.995180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 871/1733] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:46.996716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdacf09-11a1-4655-abef-616eb3cbbb1c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:46.997012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdacf09-11a1-4655-abef-616eb3cbbb1c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:46.997294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdacf09-11a1-4655-abef-616eb3cbbb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:47.010591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5b03efca-b419-4bca-9e9e-cec4769575bf None None] MFA Rules not processed for user `0dcd91485edd48b2ae7b4c40376473eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:47.014326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5b03efca-b419-4bca-9e9e-cec4769575bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:47.035169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ccdacf09-11a1-4655-abef-616eb3cbbb1c None None] MFA Rules not processed for user `2e62ee26eac94ecbb67f005fd347ccbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:47.036665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ccdacf09-11a1-4655-abef-616eb3cbbb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:47.175078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 863/1734] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:47.175282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 872/1735] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:47.175403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03efca-b419-4bca-9e9e-cec4769575bf None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:47.176089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdacf09-11a1-4655-abef-616eb3cbbb1c None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:47.281655 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03efca-b419-4bca-9e9e-cec4769575bf None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:47.288032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba10915-c35e-4d45-a8ed-81a7a4641030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:47.290312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10915-c35e-4d45-a8ed-81a7a4641030 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:47.290312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10915-c35e-4d45-a8ed-81a7a4641030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:47.290312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10915-c35e-4d45-a8ed-81a7a4641030 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:47.291979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba10915-c35e-4d45-a8ed-81a7a4641030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:47.294352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba10915-c35e-4d45-a8ed-81a7a4641030 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:47.357446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdacf09-11a1-4655-abef-616eb3cbbb1c None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:47.364718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b1930-a4ed-49b8-aa1f-2f9cd6d0c942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:47.366561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b1930-a4ed-49b8-aa1f-2f9cd6d0c942 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:47.367093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b1930-a4ed-49b8-aa1f-2f9cd6d0c942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:47.367382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b1930-a4ed-49b8-aa1f-2f9cd6d0c942 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:47.370086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b1930-a4ed-49b8-aa1f-2f9cd6d0c942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:47.372639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b1930-a4ed-49b8-aa1f-2f9cd6d0c942 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:47.410292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 864/1736] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:47 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:47.414109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba10915-c35e-4d45-a8ed-81a7a4641030 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:47.524802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba10915-c35e-4d45-a8ed-81a7a4641030 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:47.545740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18d9bf-9dbb-4e76-a198-d53c803f7dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:47.552092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18d9bf-9dbb-4e76-a198-d53c803f7dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:47.552092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18d9bf-9dbb-4e76-a198-d53c803f7dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:47.552092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18d9bf-9dbb-4e76-a198-d53c803f7dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:47.552092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18d9bf-9dbb-4e76-a198-d53c803f7dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:47.556327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18d9bf-9dbb-4e76-a198-d53c803f7dd1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:47.566331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 873/1737] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:39:47 2022] POST /identity/v3/projects => generated 409 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:47.570047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b1930-a4ed-49b8-aa1f-2f9cd6d0c942 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:47.718104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b1930-a4ed-49b8-aa1f-2f9cd6d0c942 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:47.724243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1b503-c8d0-4adc-b406-79035eac1eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:47.726102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1b503-c8d0-4adc-b406-79035eac1eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:47.726379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1b503-c8d0-4adc-b406-79035eac1eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:47.728528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 865/1738] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:47 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:39:47.728849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1b503-c8d0-4adc-b406-79035eac1eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:47.729739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1b503-c8d0-4adc-b406-79035eac1eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:47.733743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18d9bf-9dbb-4e76-a198-d53c803f7dd1 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:47.735727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1b503-c8d0-4adc-b406-79035eac1eb9 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:47.738685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ed18d9bf-9dbb-4e76-a198-d53c803f7dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:47.871384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 874/1739] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:39:47 2022] POST /identity/v3/users => generated 311 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:39:47.872371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1b503-c8d0-4adc-b406-79035eac1eb9 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:47.894128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:47.906189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1b503-c8d0-4adc-b406-79035eac1eb9 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:47.912931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479994c-b7ae-452d-a0ce-c3c55800f7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:47.913964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479994c-b7ae-452d-a0ce-c3c55800f7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:47.914466 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479994c-b7ae-452d-a0ce-c3c55800f7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:47.914953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479994c-b7ae-452d-a0ce-c3c55800f7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:47.915984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479994c-b7ae-452d-a0ce-c3c55800f7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:47.918147 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479994c-b7ae-452d-a0ce-c3c55800f7d0 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:47.931672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 875/1740] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:47.933634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479994c-b7ae-452d-a0ce-c3c55800f7d0 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:47.935653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18d9bf-9dbb-4e76-a198-d53c803f7dd1 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:47.946744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479994c-b7ae-452d-a0ce-c3c55800f7d0 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:47.954219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ca0f-0da3-450f-a673-e5737968e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:47.955246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ca0f-0da3-450f-a673-e5737968e137 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:47.955718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ca0f-0da3-450f-a673-e5737968e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:47.956241 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ca0f-0da3-450f-a673-e5737968e137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:47.957191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ca0f-0da3-450f-a673-e5737968e137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:47.959612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ca0f-0da3-450f-a673-e5737968e137 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:47.975925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 876/1741] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:47.977191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ca0f-0da3-450f-a673-e5737968e137 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:47.980979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9c04ca0f-0da3-450f-a673-e5737968e137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:48.035249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf4c40-c3de-48f6-ad01-fb513b4c72a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:48.036248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf4c40-c3de-48f6-ad01-fb513b4c72a9 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:48.036932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf4c40-c3de-48f6-ad01-fb513b4c72a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:48.037042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf4c40-c3de-48f6-ad01-fb513b4c72a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:48.040257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cdcf4c40-c3de-48f6-ad01-fb513b4c72a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:48.072329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:48.078462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf4c40-c3de-48f6-ad01-fb513b4c72a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:48.080639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf4c40-c3de-48f6-ad01-fb513b4c72a9 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:48.093518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ca0f-0da3-450f-a673-e5737968e137 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:48.101520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc141e5-09d6-43df-9678-005593ce817a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:48.102177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 866/1742] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:48.103390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc141e5-09d6-43df-9678-005593ce817a service placement] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:48.103863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc141e5-09d6-43df-9678-005593ce817a service placement] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:48.104408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc141e5-09d6-43df-9678-005593ce817a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:48.115982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf4c40-c3de-48f6-ad01-fb513b4c72a9 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:48.119816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc141e5-09d6-43df-9678-005593ce817a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:48.122398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc141e5-09d6-43df-9678-005593ce817a service placement] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:48.138320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 877/1743] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:48.139613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc141e5-09d6-43df-9678-005593ce817a service placement] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:48.154048 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc141e5-09d6-43df-9678-005593ce817a service placement] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:48.162373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da009f-f7de-4570-a4ab-ce4be04349f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:48.163730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da009f-f7de-4570-a4ab-ce4be04349f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:48.164242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da009f-f7de-4570-a4ab-ce4be04349f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:48.164787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da009f-f7de-4570-a4ab-ce4be04349f8 admin admin] PATH_INFO: `/v3/projects/bf0cd8773ab546a892a9abdf777e0b06/users/3cd14453029b4beb81728c9aa1a901ca/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:48.186014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da009f-f7de-4570-a4ab-ce4be04349f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0cd8773ab546a892a9abdf777e0b06, user_id=3cd14453029b4beb81728c9aa1a901ca, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:48.192516 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da009f-f7de-4570-a4ab-ce4be04349f8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:48.201704 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf4c40-c3de-48f6-ad01-fb513b4c72a9 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:48.226469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4451b-9b26-4635-9919-657121ad1719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:48.227755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4451b-9b26-4635-9919-657121ad1719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:48.228048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4451b-9b26-4635-9919-657121ad1719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:48.228406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4451b-9b26-4635-9919-657121ad1719 admin admin] PATH_INFO: `/v3/projects/c14bf8198059415fbaa2f44e68894514/users/dc2ff1d3de034578877fb9c20c93fd99/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:48.274424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4451b-9b26-4635-9919-657121ad1719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14bf8198059415fbaa2f44e68894514, user_id=dc2ff1d3de034578877fb9c20c93fd99, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:48.277143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4451b-9b26-4635-9919-657121ad1719 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:48.278128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 878/1744] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:48 2022] PUT /identity/v3/projects/bf0cd8773ab546a892a9abdf777e0b06/users/3cd14453029b4beb81728c9aa1a901ca/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:48.285978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da009f-f7de-4570-a4ab-ce4be04349f8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:48.461629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 867/1745] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:48 2022] PUT /identity/v3/projects/c14bf8198059415fbaa2f44e68894514/users/dc2ff1d3de034578877fb9c20c93fd99/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:48.461822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da009f-f7de-4570-a4ab-ce4be04349f8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:48.464215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4451b-9b26-4635-9919-657121ad1719 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:48.655759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4451b-9b26-4635-9919-657121ad1719 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:48.664174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d2c46-487b-47ab-b1d9-b2b393f36111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:48.665639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d2c46-487b-47ab-b1d9-b2b393f36111 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:48.666174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d2c46-487b-47ab-b1d9-b2b393f36111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:48.666288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e976f-e5b0-465c-a387-0abd57090d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:48.666602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d2c46-487b-47ab-b1d9-b2b393f36111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:48.666873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e976f-e5b0-465c-a387-0abd57090d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:48.667156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e976f-e5b0-465c-a387-0abd57090d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:48.667337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d2c46-487b-47ab-b1d9-b2b393f36111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:48.667447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e976f-e5b0-465c-a387-0abd57090d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:48.668184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e976f-e5b0-465c-a387-0abd57090d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:48.669870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e976f-e5b0-465c-a387-0abd57090d97 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:48.675537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d2c46-487b-47ab-b1d9-b2b393f36111 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:48.699903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 879/1746] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:39:48.701604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 868/1747] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:39:48.708417 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e976f-e5b0-465c-a387-0abd57090d97 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:48.710028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d2c46-487b-47ab-b1d9-b2b393f36111 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:48.728482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e976f-e5b0-465c-a387-0abd57090d97 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:48.733822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d2c46-487b-47ab-b1d9-b2b393f36111 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:48.739418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1be88c-2d8c-4f16-9011-3799cc2c42bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:48.740375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be88c-2d8c-4f16-9011-3799cc2c42bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:48.740641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be88c-2d8c-4f16-9011-3799cc2c42bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:48.740922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be88c-2d8c-4f16-9011-3799cc2c42bc admin admin] PATH_INFO: `/v3/projects/c14bf8198059415fbaa2f44e68894514/users/dc2ff1d3de034578877fb9c20c93fd99/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:48.745425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1be88c-2d8c-4f16-9011-3799cc2c42bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14bf8198059415fbaa2f44e68894514, user_id=dc2ff1d3de034578877fb9c20c93fd99, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:48.748432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ad03-34c5-4d51-90fb-c6cf0c33d2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:48.749334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ad03-34c5-4d51-90fb-c6cf0c33d2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:48.749762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ad03-34c5-4d51-90fb-c6cf0c33d2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:48.750063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ad03-34c5-4d51-90fb-c6cf0c33d2f2 admin admin] PATH_INFO: `/v3/projects/bf0cd8773ab546a892a9abdf777e0b06/users/3cd14453029b4beb81728c9aa1a901ca/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:48.752199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1be88c-2d8c-4f16-9011-3799cc2c42bc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:48.755869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61ad03-34c5-4d51-90fb-c6cf0c33d2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0cd8773ab546a892a9abdf777e0b06, user_id=3cd14453029b4beb81728c9aa1a901ca, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:48.760264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61ad03-34c5-4d51-90fb-c6cf0c33d2f2 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:48.776881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 869/1748] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:48 2022] PUT /identity/v3/projects/c14bf8198059415fbaa2f44e68894514/users/dc2ff1d3de034578877fb9c20c93fd99/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:48.780165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 880/1749] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:39:48 2022] PUT /identity/v3/projects/bf0cd8773ab546a892a9abdf777e0b06/users/3cd14453029b4beb81728c9aa1a901ca/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:39:48.806536 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95339bb6-b8b8-4364-9d0d-23f62eaab422 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:48.806830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95339bb6-b8b8-4364-9d0d-23f62eaab422 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:48.807381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95339bb6-b8b8-4364-9d0d-23f62eaab422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:48.809558 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aea49-3320-42c2-a35a-1a4b7935fce6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:48.809855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aea49-3320-42c2-a35a-1a4b7935fce6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:48.810146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aea49-3320-42c2-a35a-1a4b7935fce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:48.877263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-95339bb6-b8b8-4364-9d0d-23f62eaab422 None None] MFA Rules not processed for user `dc2ff1d3de034578877fb9c20c93fd99`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:48.878797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-95339bb6-b8b8-4364-9d0d-23f62eaab422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:48.880013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0b1aea49-3320-42c2-a35a-1a4b7935fce6 None None] MFA Rules not processed for user `3cd14453029b4beb81728c9aa1a901ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:48.882048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0b1aea49-3320-42c2-a35a-1a4b7935fce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:49.091690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 881/1750] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:49.099832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95339bb6-b8b8-4364-9d0d-23f62eaab422 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:49.265891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95339bb6-b8b8-4364-9d0d-23f62eaab422 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:49.277361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da61c21-f22f-47a1-9347-c88dec82ef17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:49.278190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61c21-f22f-47a1-9347-c88dec82ef17 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:49.278767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61c21-f22f-47a1-9347-c88dec82ef17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:49.283596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61c21-f22f-47a1-9347-c88dec82ef17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:49.313976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da61c21-f22f-47a1-9347-c88dec82ef17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:49.328593 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da61c21-f22f-47a1-9347-c88dec82ef17 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:49.328780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:49.351748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 882/1751] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:49.504658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 870/1752] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 700 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:49.567598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da61c21-f22f-47a1-9347-c88dec82ef17 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:49.569986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-1da61c21-f22f-47a1-9347-c88dec82ef17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:49.591960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da61c21-f22f-47a1-9347-c88dec82ef17 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:49.597220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6e32-a975-4877-82d9-e9d3fa29061b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:49.598668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6e32-a975-4877-82d9-e9d3fa29061b service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:49.599165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6e32-a975-4877-82d9-e9d3fa29061b service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:49.599655 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6e32-a975-4877-82d9-e9d3fa29061b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:49.620244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f6e32-a975-4877-82d9-e9d3fa29061b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:49.622087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f6e32-a975-4877-82d9-e9d3fa29061b service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:49.663462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 883/1753] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:50.093688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a79a-ef1d-4cef-aacd-889bc42b6efd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:50.094828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a79a-ef1d-4cef-aacd-889bc42b6efd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:50.095329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a79a-ef1d-4cef-aacd-889bc42b6efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:50.158113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b465a79a-ef1d-4cef-aacd-889bc42b6efd None None] MFA Rules not processed for user `f814a06f54894fa2992d3ba3be21b4db`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:50.161567 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6e32-a975-4877-82d9-e9d3fa29061b service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:50.181467 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b465a79a-ef1d-4cef-aacd-889bc42b6efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:50.183373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6e32-a975-4877-82d9-e9d3fa29061b service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:50.199146 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775cda9-4174-4f60-8a25-5dffc9dc0526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:50.201209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775cda9-4174-4f60-8a25-5dffc9dc0526 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:50.203796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775cda9-4174-4f60-8a25-5dffc9dc0526 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:50.204486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775cda9-4174-4f60-8a25-5dffc9dc0526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:50.419727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775cda9-4174-4f60-8a25-5dffc9dc0526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:50.422626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775cda9-4174-4f60-8a25-5dffc9dc0526 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:50.462249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 871/1754] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:39:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:50.477742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 884/1755] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:39:50.551083 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465a79a-ef1d-4cef-aacd-889bc42b6efd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:50.570364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465a79a-ef1d-4cef-aacd-889bc42b6efd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:50.573412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1d584-8ff2-48c1-9178-a7cb37ef5353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:50.574940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1d584-8ff2-48c1-9178-a7cb37ef5353 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:50.575376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1d584-8ff2-48c1-9178-a7cb37ef5353 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:50.575661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1d584-8ff2-48c1-9178-a7cb37ef5353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:50.662947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1d584-8ff2-48c1-9178-a7cb37ef5353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:50.664899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1d584-8ff2-48c1-9178-a7cb37ef5353 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:50.682861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 872/1756] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:51.236851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:51.667673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:54.220681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb34a8-4c73-413f-81f8-b73269ed4d65 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:54.221155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb34a8-4c73-413f-81f8-b73269ed4d65 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:54.221456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb34a8-4c73-413f-81f8-b73269ed4d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:54.268190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-c8fb34a8-4c73-413f-81f8-b73269ed4d65 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:54.269931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c8fb34a8-4c73-413f-81f8-b73269ed4d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:54.414249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 885/1757] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:39:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:39:54.737276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1d584-8ff2-48c1-9178-a7cb37ef5353 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:54.738926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-81b1d584-8ff2-48c1-9178-a7cb37ef5353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:54.853024 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1d584-8ff2-48c1-9178-a7cb37ef5353 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:54.858599 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de9af0-7f7b-49a0-b555-7d582288c7e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:54.859308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de9af0-7f7b-49a0-b555-7d582288c7e4 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:54.859596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de9af0-7f7b-49a0-b555-7d582288c7e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:54.859875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de9af0-7f7b-49a0-b555-7d582288c7e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:54.896218 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de9af0-7f7b-49a0-b555-7d582288c7e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:54.903909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de9af0-7f7b-49a0-b555-7d582288c7e4 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:54.933277 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 873/1758] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:39:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:39:55.426082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:55.876448 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:56.214666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5de4d-74ef-46ac-bce3-ed893f4ab930 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:56.214666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5de4d-74ef-46ac-bce3-ed893f4ab930 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:56.214666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5de4d-74ef-46ac-bce3-ed893f4ab930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:56.214666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-97d5de4d-74ef-46ac-bce3-ed893f4ab930 None None] MFA Rules not processed for user `19ce01cdbd8d4ac9bb126a6814f2d13b`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:56.214666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-97d5de4d-74ef-46ac-bce3-ed893f4ab930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:56.214666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 886/1759] 10.222.0.87 () {58 vars in 1015 bytes} [Thu Jun 16 17:39:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:56.217460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de9af0-7f7b-49a0-b555-7d582288c7e4 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:56.217460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-40de9af0-7f7b-49a0-b555-7d582288c7e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:56.221071 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de9af0-7f7b-49a0-b555-7d582288c7e4 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:56.226567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edfe3a-7874-4151-8a52-40f6e69185fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:56.228016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edfe3a-7874-4151-8a52-40f6e69185fe service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:56.228597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edfe3a-7874-4151-8a52-40f6e69185fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:56.229450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edfe3a-7874-4151-8a52-40f6e69185fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:56.250496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edfe3a-7874-4151-8a52-40f6e69185fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:56.255949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edfe3a-7874-4151-8a52-40f6e69185fe service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:56.269487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 874/1760] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:39:58.675682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:58.765903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3b1b-db51-4679-acde-4752a1f5c3bb None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:58.766681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3b1b-db51-4679-acde-4752a1f5c3bb None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:58.767034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3b1b-db51-4679-acde-4752a1f5c3bb None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:58.769390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 887/1761] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:39:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:39:58.825645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b24fd-5171-4256-a5f0-c99105059cbe None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:58.826623 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b24fd-5171-4256-a5f0-c99105059cbe None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:58.827279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b24fd-5171-4256-a5f0-c99105059cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:58.869266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-822b24fd-5171-4256-a5f0-c99105059cbe None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:39:58.887877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-822b24fd-5171-4256-a5f0-c99105059cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:59.057068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 875/1762] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:39:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:39:59.059622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:59.563547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c3b1b-db51-4679-acde-4752a1f5c3bb None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:39:59.565899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-835c3b1b-db51-4679-acde-4752a1f5c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:39:59.598568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c3b1b-db51-4679-acde-4752a1f5c3bb None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:39:59.608447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa1f11-2580-40a0-86e4-20af8d5e3d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:39:59.609508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1f11-2580-40a0-86e4-20af8d5e3d11 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:39:59.611063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1f11-2580-40a0-86e4-20af8d5e3d11 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:39:59.611869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1f11-2580-40a0-86e4-20af8d5e3d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:39:59.639342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa1f11-2580-40a0-86e4-20af8d5e3d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:39:59.643399 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa1f11-2580-40a0-86e4-20af8d5e3d11 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:39:59.667580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 888/1763] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:39:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:00.431471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:00.852475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:01.856616 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:02.079721 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9fa4b-bc8f-4d3f-bafa-3badb422899e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:02.080904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9fa4b-bc8f-4d3f-bafa-3badb422899e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:02.081502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9fa4b-bc8f-4d3f-bafa-3badb422899e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:02.087649 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 876/1764] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:40:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:40:02.111234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:02.237720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc976-0690-40b0-a65e-8eb16b5d4709 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:02.238396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc976-0690-40b0-a65e-8eb16b5d4709 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:02.238913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc976-0690-40b0-a65e-8eb16b5d4709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:02.274081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-40bdc976-0690-40b0-a65e-8eb16b5d4709 None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:02.276672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-40bdc976-0690-40b0-a65e-8eb16b5d4709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:02.304066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 889/1765] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:40:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:02.971511 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9fa4b-bc8f-4d3f-bafa-3badb422899e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:02.998775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9fa4b-bc8f-4d3f-bafa-3badb422899e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:03.021771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ce10d-0cf3-4082-a90e-4a0c5cf80528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:03.023143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ce10d-0cf3-4082-a90e-4a0c5cf80528 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:03.023770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ce10d-0cf3-4082-a90e-4a0c5cf80528 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:03.024489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ce10d-0cf3-4082-a90e-4a0c5cf80528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:03.037847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ce10d-0cf3-4082-a90e-4a0c5cf80528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:03.041318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ce10d-0cf3-4082-a90e-4a0c5cf80528 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:03.090211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 877/1766] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:03.745444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdc976-0690-40b0-a65e-8eb16b5d4709 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:03.769854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ce10d-0cf3-4082-a90e-4a0c5cf80528 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:03.871209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdc976-0690-40b0-a65e-8eb16b5d4709 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:03.897559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:03.901767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:03.902458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:03.904510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] PATH_INFO: `/v3/users/2e62ee26eac94ecbb67f005fd347ccbb` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:03.908906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e62ee26eac94ecbb67f005fd347ccbb)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:03.915731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:03.926324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ce10d-0cf3-4082-a90e-4a0c5cf80528 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:03.933042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:03.934127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:03.934734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:03.935185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] PATH_INFO: `/v3/users/0dcd91485edd48b2ae7b4c40376473eb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:03.936776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcd91485edd48b2ae7b4c40376473eb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:03.939268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:04.112509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:04.290695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcd91485edd48b2ae7b4c40376473eb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:04.307888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcd91485edd48b2ae7b4c40376473eb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:04.391604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e62ee26eac94ecbb67f005fd347ccbb'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:04.400291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcd91485edd48b2ae7b4c40376473eb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:04.401231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcd91485edd48b2ae7b4c40376473eb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:04.401968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f04ed927-b246-4339-b32b-0f3c82878d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcd91485edd48b2ae7b4c40376473eb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:04.434617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 878/1767] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:03 2022] DELETE /identity/v3/users/0dcd91485edd48b2ae7b4c40376473eb => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:04.439388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e62ee26eac94ecbb67f005fd347ccbb'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:04.441070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c8671-378b-4819-848c-894e77f0255b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:04.450165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c8671-378b-4819-848c-894e77f0255b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:04.450165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c8671-378b-4819-848c-894e77f0255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:04.489031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ad1c8671-378b-4819-848c-894e77f0255b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:04.490368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ad1c8671-378b-4819-848c-894e77f0255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:04.538940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e62ee26eac94ecbb67f005fd347ccbb'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:04.540910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e62ee26eac94ecbb67f005fd347ccbb'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:04.547364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7e0444b5-92e1-4cee-a556-7634180a2622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e62ee26eac94ecbb67f005fd347ccbb'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:04.583935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 890/1768] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:03 2022] DELETE /identity/v3/users/2e62ee26eac94ecbb67f005fd347ccbb => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:04.590603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148eb3e-d610-4b31-ae8f-660908addaeb None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:04.590900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148eb3e-d610-4b31-ae8f-660908addaeb None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:04.591185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148eb3e-d610-4b31-ae8f-660908addaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:04.660815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-1148eb3e-d610-4b31-ae8f-660908addaeb None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:04.661268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 879/1769] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:04.668512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-1148eb3e-d610-4b31-ae8f-660908addaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:04.732160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c8671-378b-4819-848c-894e77f0255b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:04.733603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ad1c8671-378b-4819-848c-894e77f0255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:04.830005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:04.855228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 891/1770] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:04.866795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148eb3e-d610-4b31-ae8f-660908addaeb None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:04.869483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-1148eb3e-d610-4b31-ae8f-660908addaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:04.879324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c8671-378b-4819-848c-894e77f0255b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:04.998917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bf86d-23ce-446d-a4cb-fd50d60ea4fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:05.000140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf86d-23ce-446d-a4cb-fd50d60ea4fe service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:05.002188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf86d-23ce-446d-a4cb-fd50d60ea4fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:05.002188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf86d-23ce-446d-a4cb-fd50d60ea4fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:05.017662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148eb3e-d610-4b31-ae8f-660908addaeb None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:05.024852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bf86d-23ce-446d-a4cb-fd50d60ea4fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:05.026425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bf86d-23ce-446d-a4cb-fd50d60ea4fe service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:05.031100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfe930-262d-4a60-8146-8c44f5ad2dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:05.031963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe930-262d-4a60-8146-8c44f5ad2dde service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:05.032387 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe930-262d-4a60-8146-8c44f5ad2dde service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:05.032764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe930-262d-4a60-8146-8c44f5ad2dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:05.046257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfe930-262d-4a60-8146-8c44f5ad2dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:05.047870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfe930-262d-4a60-8146-8c44f5ad2dde service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:05.070265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 892/1771] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:05.075801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 880/1772] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:05.582546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:06.043011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfe930-262d-4a60-8146-8c44f5ad2dde service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:06.045219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-67cfe930-262d-4a60-8146-8c44f5ad2dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:06.081519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfe930-262d-4a60-8146-8c44f5ad2dde service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:06.089319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:06.090500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:06.091957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:06.092621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] PATH_INFO: `/v3/projects/be8ff8f13e214faa85f5fe78b1377328` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:06.097808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8ff8f13e214faa85f5fe78b1377328)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:06.101353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:06.181662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:06.265198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8ff8f13e214faa85f5fe78b1377328', 'request_id': 'req-a71c743b-fa8a-43fc-8ca5-85b89914914b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:06.277532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8ff8f13e214faa85f5fe78b1377328', 'request_id': 'req-a71c743b-fa8a-43fc-8ca5-85b89914914b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:06.286421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8ff8f13e214faa85f5fe78b1377328', 'request_id': 'req-a71c743b-fa8a-43fc-8ca5-85b89914914b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:06.404573 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] The token cache is being invalidate because project be8ff8f13e214faa85f5fe78b1377328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:06.404869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:06.405554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:06.412154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 893/1773] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:06 2022] DELETE /identity/v3/projects/be8ff8f13e214faa85f5fe78b1377328 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:06.417548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bf86d-23ce-446d-a4cb-fd50d60ea4fe service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:06.432470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bf86d-23ce-446d-a4cb-fd50d60ea4fe service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:06.513602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:06.517369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:06.517369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:06.517369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] PATH_INFO: `/v3/users/3cd14453029b4beb81728c9aa1a901ca` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:06.519812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd14453029b4beb81728c9aa1a901ca)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:06.521871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:06.754944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd14453029b4beb81728c9aa1a901ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:06.824442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd14453029b4beb81728c9aa1a901ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:07.025723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd14453029b4beb81728c9aa1a901ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:07.026671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd14453029b4beb81728c9aa1a901ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:07.027862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd14453029b4beb81728c9aa1a901ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:07.045629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 881/1774] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:06 2022] DELETE /identity/v3/users/3cd14453029b4beb81728c9aa1a901ca => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:07.210145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:07.212409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:07.230881 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c743b-fa8a-43fc-8ca5-85b89914914b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:07.312583 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:07.313828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:07.315654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:07.315959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] PATH_INFO: `/v3/projects/dc1a4b7738854584aa90437320befbd5` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:07.319733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1a4b7738854584aa90437320befbd5)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:07.361800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:07.923753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:07.954276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1a4b7738854584aa90437320befbd5', 'request_id': 'req-9c836364-3b93-4943-9250-89acac9b06be'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:07.962668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1a4b7738854584aa90437320befbd5', 'request_id': 'req-9c836364-3b93-4943-9250-89acac9b06be'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:07.976781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:07.980975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:07.982408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1a4b7738854584aa90437320befbd5', 'request_id': 'req-9c836364-3b93-4943-9250-89acac9b06be'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:07.997037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05797d-cb2e-4139-a63c-55807fbd7736 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:08.085475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:08.087421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:08.087790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:08.088177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] PATH_INFO: `/v3/projects/bf0cd8773ab546a892a9abdf777e0b06` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:08.089752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0cd8773ab546a892a9abdf777e0b06)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:08.096142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:08.109604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] The token cache is being invalidate because project dc1a4b7738854584aa90437320befbd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:08.110262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.111348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.115167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 894/1775] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:07 2022] DELETE /identity/v3/projects/dc1a4b7738854584aa90437320befbd5 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:08.121575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:08.123995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:08.137982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836364-3b93-4943-9250-89acac9b06be admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:08.142981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:08.143868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:08.144187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:08.144468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] PATH_INFO: `/v3/users/dc2ff1d3de034578877fb9c20c93fd99` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:08.145727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2ff1d3de034578877fb9c20c93fd99)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:08.147962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:08.242319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0cd8773ab546a892a9abdf777e0b06', 'request_id': 'req-6463ec6e-13de-4ad0-a80c-33974d4a73d5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.248033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0cd8773ab546a892a9abdf777e0b06', 'request_id': 'req-6463ec6e-13de-4ad0-a80c-33974d4a73d5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.355835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0cd8773ab546a892a9abdf777e0b06', 'request_id': 'req-6463ec6e-13de-4ad0-a80c-33974d4a73d5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.367838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] The token cache is being invalidate because project bf0cd8773ab546a892a9abdf777e0b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:08.368374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.369051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6463ec6e-13de-4ad0-a80c-33974d4a73d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.370603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 882/1776] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:07 2022] DELETE /identity/v3/projects/bf0cd8773ab546a892a9abdf777e0b06 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:08.375285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088b82-5e25-4f53-bfcb-eff8ea46c7c0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:08.375596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088b82-5e25-4f53-bfcb-eff8ea46c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:08.375881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088b82-5e25-4f53-bfcb-eff8ea46c7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:08.394836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c1088b82-5e25-4f53-bfcb-eff8ea46c7c0 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:08.396046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c1088b82-5e25-4f53-bfcb-eff8ea46c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:08.457360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 883/1777] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:08.465746 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9e88d-f1c7-4db8-992e-bf4798da6d78 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:08.466042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9e88d-f1c7-4db8-992e-bf4798da6d78 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:08.466329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9e88d-f1c7-4db8-992e-bf4798da6d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:08.484978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-37a9e88d-f1c7-4db8-992e-bf4798da6d78 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:08.486182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-37a9e88d-f1c7-4db8-992e-bf4798da6d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:08.495225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 884/1778] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:08.502412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9e88d-f1c7-4db8-992e-bf4798da6d78 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:08.513106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9e88d-f1c7-4db8-992e-bf4798da6d78 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:08.513856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2ff1d3de034578877fb9c20c93fd99'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.517976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf902c4e-9d47-4e40-b981-0868ca5a92bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:08.518410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf902c4e-9d47-4e40-b981-0868ca5a92bf admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:08.518689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf902c4e-9d47-4e40-b981-0868ca5a92bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:08.518965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf902c4e-9d47-4e40-b981-0868ca5a92bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:08.519703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf902c4e-9d47-4e40-b981-0868ca5a92bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:08.519984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf902c4e-9d47-4e40-b981-0868ca5a92bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:08.521609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf902c4e-9d47-4e40-b981-0868ca5a92bf admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:08.528985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2ff1d3de034578877fb9c20c93fd99'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.534750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 885/1779] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:08.539025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf902c4e-9d47-4e40-b981-0868ca5a92bf admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:08.556351 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf902c4e-9d47-4e40-b981-0868ca5a92bf admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:08.563151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7de67c-da9a-4289-bd07-7c1c65ba9f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:08.563867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7de67c-da9a-4289-bd07-7c1c65ba9f4b admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:08.564186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7de67c-da9a-4289-bd07-7c1c65ba9f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:08.564461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7de67c-da9a-4289-bd07-7c1c65ba9f4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:08.565144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7de67c-da9a-4289-bd07-7c1c65ba9f4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:08.567018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7de67c-da9a-4289-bd07-7c1c65ba9f4b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:08.636301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2ff1d3de034578877fb9c20c93fd99'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.637223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2ff1d3de034578877fb9c20c93fd99'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.637970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2ff1d3de034578877fb9c20c93fd99'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:08.652402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 895/1780] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:08 2022] DELETE /identity/v3/users/dc2ff1d3de034578877fb9c20c93fd99 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:08.703280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 886/1781] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:08 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:08.707501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:08.709428 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:08.799101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a55ed-6e72-478d-a603-ce4bbd710fd7 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:08.858714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b147e2b-3889-45e7-8321-74d03981e33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:08.859312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b147e2b-3889-45e7-8321-74d03981e33e admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:08.859598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b147e2b-3889-45e7-8321-74d03981e33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:08.859870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b147e2b-3889-45e7-8321-74d03981e33e admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:08.860592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b147e2b-3889-45e7-8321-74d03981e33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:08.862501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b147e2b-3889-45e7-8321-74d03981e33e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:08.995845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 896/1782] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:08 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:08.997127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7de67c-da9a-4289-bd07-7c1c65ba9f4b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:09.007383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7de67c-da9a-4289-bd07-7c1c65ba9f4b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:09.013111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b45a5-4e81-47a7-a137-4bd1ac691eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:09.013920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b45a5-4e81-47a7-a137-4bd1ac691eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.014240 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b45a5-4e81-47a7-a137-4bd1ac691eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.014633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b45a5-4e81-47a7-a137-4bd1ac691eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.015485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b45a5-4e81-47a7-a137-4bd1ac691eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:09.017571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b45a5-4e81-47a7-a137-4bd1ac691eb1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:09.030304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 887/1783] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:09.048355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b147e2b-3889-45e7-8321-74d03981e33e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:09.060853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b147e2b-3889-45e7-8321-74d03981e33e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:09.066713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2e037-d477-4148-ac0e-254fa21209a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:09.067644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2e037-d477-4148-ac0e-254fa21209a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.067799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2e037-d477-4148-ac0e-254fa21209a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.068023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2e037-d477-4148-ac0e-254fa21209a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.068811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2e037-d477-4148-ac0e-254fa21209a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:09.070636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2e037-d477-4148-ac0e-254fa21209a8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:09.081600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 897/1784] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:09.088177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b45a5-4e81-47a7-a137-4bd1ac691eb1 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:09.098327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b45a5-4e81-47a7-a137-4bd1ac691eb1 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:09.103741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e230-ef3b-467b-9815-9990a75d2d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:09.113834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e230-ef3b-467b-9815-9990a75d2d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.113834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e230-ef3b-467b-9815-9990a75d2d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.113834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e230-ef3b-467b-9815-9990a75d2d56 admin admin] PATH_INFO: `/v3/projects/ca6c57b87ea54973ad5d22799bcab979/users/8ac3ab3be70d4f2fbb0766fad005125c/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.122133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797e230-ef3b-467b-9815-9990a75d2d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6c57b87ea54973ad5d22799bcab979, user_id=8ac3ab3be70d4f2fbb0766fad005125c, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:09.125432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797e230-ef3b-467b-9815-9990a75d2d56 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:09.347882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2e037-d477-4148-ac0e-254fa21209a8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:09.350087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-69e2e037-d477-4148-ac0e-254fa21209a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:09.387743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 888/1785] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:09 2022] PUT /identity/v3/projects/ca6c57b87ea54973ad5d22799bcab979/users/8ac3ab3be70d4f2fbb0766fad005125c/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:09.387989 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2e037-d477-4148-ac0e-254fa21209a8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:09.391985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac7c3-ad3a-4ed3-bd4e-a79beb4f7817 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.392122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac7c3-ad3a-4ed3-bd4e-a79beb4f7817 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.392413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac7c3-ad3a-4ed3-bd4e-a79beb4f7817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.465176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2a3ac7c3-ad3a-4ed3-bd4e-a79beb4f7817 None None] MFA Rules not processed for user `8ac3ab3be70d4f2fbb0766fad005125c`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:09.469094 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2a3ac7c3-ad3a-4ed3-bd4e-a79beb4f7817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:09.477353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:09.479075 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.479712 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.480111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] PATH_INFO: `/v3/projects/c14bf8198059415fbaa2f44e68894514` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.481948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14bf8198059415fbaa2f44e68894514)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:09.484065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:09.555545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 889/1786] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:09.560859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac7c3-ad3a-4ed3-bd4e-a79beb4f7817 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:09.579119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac7c3-ad3a-4ed3-bd4e-a79beb4f7817 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:09.587895 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218cc1-b47a-4dbd-b35e-52575e1ef3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:09.587895 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218cc1-b47a-4dbd-b35e-52575e1ef3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.587895 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218cc1-b47a-4dbd-b35e-52575e1ef3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.587895 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218cc1-b47a-4dbd-b35e-52575e1ef3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.589066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54218cc1-b47a-4dbd-b35e-52575e1ef3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:09.589599 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54218cc1-b47a-4dbd-b35e-52575e1ef3aa admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:09.628444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14bf8198059415fbaa2f44e68894514', 'request_id': 'req-eb6d8db2-dbff-41a4-93f3-4b287287cdad'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:09.635387 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14bf8198059415fbaa2f44e68894514', 'request_id': 'req-eb6d8db2-dbff-41a4-93f3-4b287287cdad'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:09.643047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14bf8198059415fbaa2f44e68894514', 'request_id': 'req-eb6d8db2-dbff-41a4-93f3-4b287287cdad'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:09.724368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 890/1787] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:09 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:09.728364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218cc1-b47a-4dbd-b35e-52575e1ef3aa admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:09.757163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] The token cache is being invalidate because project c14bf8198059415fbaa2f44e68894514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:09.757340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:09.760792 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-eb6d8db2-dbff-41a4-93f3-4b287287cdad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:09.767217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 898/1788] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:09 2022] DELETE /identity/v3/projects/c14bf8198059415fbaa2f44e68894514 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:09.769052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438c27-4786-4c6e-90bc-728d43b4a902 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.770212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438c27-4786-4c6e-90bc-728d43b4a902 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.770563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438c27-4786-4c6e-90bc-728d43b4a902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.798979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-68438c27-4786-4c6e-90bc-728d43b4a902 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:09.803054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-68438c27-4786-4c6e-90bc-728d43b4a902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:09.827281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 899/1789] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:09.838083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189939fc-1e21-48de-9ec2-8f94a7b2dd35 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.838651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189939fc-1e21-48de-9ec2-8f94a7b2dd35 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.839092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189939fc-1e21-48de-9ec2-8f94a7b2dd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.839900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218cc1-b47a-4dbd-b35e-52575e1ef3aa admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:09.856668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed065340-e65f-470d-a82a-f53ec449df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:09.859569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed065340-e65f-470d-a82a-f53ec449df88 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.860122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed065340-e65f-470d-a82a-f53ec449df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.860461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-189939fc-1e21-48de-9ec2-8f94a7b2dd35 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:09.861641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed065340-e65f-470d-a82a-f53ec449df88 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.862201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-189939fc-1e21-48de-9ec2-8f94a7b2dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:09.863547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed065340-e65f-470d-a82a-f53ec449df88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:09.872221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed065340-e65f-470d-a82a-f53ec449df88 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:09.873567 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 900/1790] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:09.878013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189939fc-1e21-48de-9ec2-8f94a7b2dd35 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:09.890238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189939fc-1e21-48de-9ec2-8f94a7b2dd35 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:09.896228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1410469-b76c-445d-b9dd-56b8e991ee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:09.907060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1410469-b76c-445d-b9dd-56b8e991ee10 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.907060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1410469-b76c-445d-b9dd-56b8e991ee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.907060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1410469-b76c-445d-b9dd-56b8e991ee10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.907060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1410469-b76c-445d-b9dd-56b8e991ee10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:09.907060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1410469-b76c-445d-b9dd-56b8e991ee10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:09.907060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1410469-b76c-445d-b9dd-56b8e991ee10 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:09.920303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 901/1791] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:40:09.921301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1410469-b76c-445d-b9dd-56b8e991ee10 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:09.933584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1410469-b76c-445d-b9dd-56b8e991ee10 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:09.938551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1d802-c87c-4a18-9e12-852cb2c40df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:09.939369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1d802-c87c-4a18-9e12-852cb2c40df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:09.939869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1d802-c87c-4a18-9e12-852cb2c40df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:09.940290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1d802-c87c-4a18-9e12-852cb2c40df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:09.941057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1d802-c87c-4a18-9e12-852cb2c40df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:09.943112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1d802-c87c-4a18-9e12-852cb2c40df8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.001756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 891/1792] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:09 2022] POST /identity/v3/users => generated 300 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:10.006096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed065340-e65f-470d-a82a-f53ec449df88 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:10.016155 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ed065340-e65f-470d-a82a-f53ec449df88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:10.020995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed065340-e65f-470d-a82a-f53ec449df88 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:10.026006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5260-cce2-4e9e-a2bd-f9ddc39d6c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:10.026691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5260-cce2-4e9e-a2bd-f9ddc39d6c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.027002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5260-cce2-4e9e-a2bd-f9ddc39d6c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.027280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5260-cce2-4e9e-a2bd-f9ddc39d6c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.028065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd5260-cce2-4e9e-a2bd-f9ddc39d6c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:10.029694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd5260-cce2-4e9e-a2bd-f9ddc39d6c87 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.044740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 892/1793] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:10.045244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5260-cce2-4e9e-a2bd-f9ddc39d6c87 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:10.056372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5260-cce2-4e9e-a2bd-f9ddc39d6c87 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:10.061807 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199c6a-393c-4d64-b76d-07eb93383021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:10.062905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199c6a-393c-4d64-b76d-07eb93383021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.063051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199c6a-393c-4d64-b76d-07eb93383021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.063286 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199c6a-393c-4d64-b76d-07eb93383021 admin admin] PATH_INFO: `/v3/projects/13dea416746d48d5bf502514fc49e070/users/c44791685c1a4416ad430cb84cf97f40/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.082885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07199c6a-393c-4d64-b76d-07eb93383021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13dea416746d48d5bf502514fc49e070, user_id=c44791685c1a4416ad430cb84cf97f40, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:10.086746 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07199c6a-393c-4d64-b76d-07eb93383021 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.094321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 902/1794] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:09 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:10.098664 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1d802-c87c-4a18-9e12-852cb2c40df8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:10.172839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1d802-c87c-4a18-9e12-852cb2c40df8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:10.177744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8acae3-b979-4c33-bfcc-79456ddbd857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:10.178496 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8acae3-b979-4c33-bfcc-79456ddbd857 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.178780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8acae3-b979-4c33-bfcc-79456ddbd857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.179089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8acae3-b979-4c33-bfcc-79456ddbd857 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.179872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8acae3-b979-4c33-bfcc-79456ddbd857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:10.181908 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8acae3-b979-4c33-bfcc-79456ddbd857 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.190392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:10.244343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 893/1795] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:10 2022] PUT /identity/v3/projects/13dea416746d48d5bf502514fc49e070/users/c44791685c1a4416ad430cb84cf97f40/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:10.248048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199c6a-393c-4d64-b76d-07eb93383021 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:10.317971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199c6a-393c-4d64-b76d-07eb93383021 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:10.324297 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d763d81-9107-4321-b418-fe51e51213d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:10.324978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d763d81-9107-4321-b418-fe51e51213d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.325296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d763d81-9107-4321-b418-fe51e51213d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.325599 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d763d81-9107-4321-b418-fe51e51213d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.326333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d763d81-9107-4321-b418-fe51e51213d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:10.327997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d763d81-9107-4321-b418-fe51e51213d3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.339123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 894/1796] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:10.343259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d763d81-9107-4321-b418-fe51e51213d3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:10.353547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d763d81-9107-4321-b418-fe51e51213d3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:10.358313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f76a5-1c3f-4c27-b052-31a2f1d16d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:10.359214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f76a5-1c3f-4c27-b052-31a2f1d16d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.359498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f76a5-1c3f-4c27-b052-31a2f1d16d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.359776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f76a5-1c3f-4c27-b052-31a2f1d16d0a admin admin] PATH_INFO: `/v3/projects/13dea416746d48d5bf502514fc49e070/users/c44791685c1a4416ad430cb84cf97f40/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.361770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f76a5-1c3f-4c27-b052-31a2f1d16d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13dea416746d48d5bf502514fc49e070, user_id=c44791685c1a4416ad430cb84cf97f40, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:10.364465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f76a5-1c3f-4c27-b052-31a2f1d16d0a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.373773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 903/1797] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:10 2022] POST /identity/v3/users => generated 285 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:10.376180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 895/1798] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:10 2022] PUT /identity/v3/projects/13dea416746d48d5bf502514fc49e070/users/c44791685c1a4416ad430cb84cf97f40/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:10.378335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8acae3-b979-4c33-bfcc-79456ddbd857 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:10.389292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00dc9c-25a0-423c-a7f0-6f122565dfca None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.389648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8acae3-b979-4c33-bfcc-79456ddbd857 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:10.389765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00dc9c-25a0-423c-a7f0-6f122565dfca None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.390108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00dc9c-25a0-423c-a7f0-6f122565dfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.429700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6b00dc9c-25a0-423c-a7f0-6f122565dfca None None] MFA Rules not processed for user `c44791685c1a4416ad430cb84cf97f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:10.431933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6b00dc9c-25a0-423c-a7f0-6f122565dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:10.463976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5cbdc-8d9a-4415-957e-b6ce37efb655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:10.464814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cbdc-8d9a-4415-957e-b6ce37efb655 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.465223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cbdc-8d9a-4415-957e-b6ce37efb655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.465637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cbdc-8d9a-4415-957e-b6ce37efb655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.467174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5cbdc-8d9a-4415-957e-b6ce37efb655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:10.469085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5cbdc-8d9a-4415-957e-b6ce37efb655 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.485772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 904/1799] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:10.487242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5cbdc-8d9a-4415-957e-b6ce37efb655 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:10.505418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5cbdc-8d9a-4415-957e-b6ce37efb655 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:10.511551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19e7c-f3be-47c0-b513-aea43f256233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:10.512585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19e7c-f3be-47c0-b513-aea43f256233 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.513042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19e7c-f3be-47c0-b513-aea43f256233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.513619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19e7c-f3be-47c0-b513-aea43f256233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.514520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f19e7c-f3be-47c0-b513-aea43f256233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:10.517184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f19e7c-f3be-47c0-b513-aea43f256233 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.530325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 905/1800] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:10.537106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19e7c-f3be-47c0-b513-aea43f256233 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:10.547833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19e7c-f3be-47c0-b513-aea43f256233 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:10.553272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb19609-0a74-4b29-a5f4-a65d78edb957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:10.554217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19609-0a74-4b29-a5f4-a65d78edb957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.554494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19609-0a74-4b29-a5f4-a65d78edb957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.554949 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19609-0a74-4b29-a5f4-a65d78edb957 admin admin] PATH_INFO: `/v3/projects/ac9a1ecf8d00436f8d1c3f84d3463ce7/users/248ca3449696476e8146a536bb5c263d/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.590674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb19609-0a74-4b29-a5f4-a65d78edb957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9a1ecf8d00436f8d1c3f84d3463ce7, user_id=248ca3449696476e8146a536bb5c263d, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:10.592245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 896/1801] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:10.593019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00dc9c-25a0-423c-a7f0-6f122565dfca None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:10.594385 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6b00dc9c-25a0-423c-a7f0-6f122565dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:10.597958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb19609-0a74-4b29-a5f4-a65d78edb957 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.610569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00dc9c-25a0-423c-a7f0-6f122565dfca None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:10.615429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:10.616411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.616695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.616972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] PATH_INFO: `/v3/users/19aef2143015486ea920cf486bbe3ba2` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.618846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19aef2143015486ea920cf486bbe3ba2)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:10.620816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.756886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 906/1802] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:10 2022] PUT /identity/v3/projects/ac9a1ecf8d00436f8d1c3f84d3463ce7/users/248ca3449696476e8146a536bb5c263d/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:10.759180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb19609-0a74-4b29-a5f4-a65d78edb957 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:10.760552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ceb19609-0a74-4b29-a5f4-a65d78edb957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:10.822019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19aef2143015486ea920cf486bbe3ba2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:10.822260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb19609-0a74-4b29-a5f4-a65d78edb957 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:10.825868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90858294-2739-42cb-a172-c5d68f80a0f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:10.826528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90858294-2739-42cb-a172-c5d68f80a0f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.826815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90858294-2739-42cb-a172-c5d68f80a0f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.827375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90858294-2739-42cb-a172-c5d68f80a0f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.834909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19aef2143015486ea920cf486bbe3ba2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:10.895658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90858294-2739-42cb-a172-c5d68f80a0f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:10.897118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90858294-2739-42cb-a172-c5d68f80a0f8 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:10.906839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 907/1803] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:10.908116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc511d7a-2556-4493-a608-14973448428f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.908442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc511d7a-2556-4493-a608-14973448428f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.908668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc511d7a-2556-4493-a608-14973448428f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.916371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19aef2143015486ea920cf486bbe3ba2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:10.917013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19aef2143015486ea920cf486bbe3ba2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:10.917631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-683dd22d-69be-49d4-bc5c-3600d497dc97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19aef2143015486ea920cf486bbe3ba2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:10.932442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 897/1804] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:10 2022] DELETE /identity/v3/users/19aef2143015486ea920cf486bbe3ba2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:10.937226 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6344be-7fe0-4432-b4aa-97d33b972de7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:10.937540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6344be-7fe0-4432-b4aa-97d33b972de7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:10.938018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6344be-7fe0-4432-b4aa-97d33b972de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:10.942850 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-fc511d7a-2556-4493-a608-14973448428f None None] MFA Rules not processed for user `248ca3449696476e8146a536bb5c263d`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:10.944188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fc511d7a-2556-4493-a608-14973448428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:10.962540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8a6344be-7fe0-4432-b4aa-97d33b972de7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:10.964470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8a6344be-7fe0-4432-b4aa-97d33b972de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:11.023859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 908/1805] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:11.028384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc511d7a-2556-4493-a608-14973448428f None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:11.030216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fc511d7a-2556-4493-a608-14973448428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:11.044710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 898/1806] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:11.057762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6344be-7fe0-4432-b4aa-97d33b972de7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:11.059853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8a6344be-7fe0-4432-b4aa-97d33b972de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:11.110481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc511d7a-2556-4493-a608-14973448428f None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:11.116094 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38736a7f-06f2-4d82-b6ad-26916176a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:11.116757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736a7f-06f2-4d82-b6ad-26916176a01f admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:11.117051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736a7f-06f2-4d82-b6ad-26916176a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:11.118491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736a7f-06f2-4d82-b6ad-26916176a01f admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:11.119203 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38736a7f-06f2-4d82-b6ad-26916176a01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:11.121160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38736a7f-06f2-4d82-b6ad-26916176a01f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:11.130130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6344be-7fe0-4432-b4aa-97d33b972de7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:11.134197 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab9136-9aa8-4a16-b311-24aee534c80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:11.134921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9136-9aa8-4a16-b311-24aee534c80f service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:11.135255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9136-9aa8-4a16-b311-24aee534c80f service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:11.135548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9136-9aa8-4a16-b311-24aee534c80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:11.145869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab9136-9aa8-4a16-b311-24aee534c80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:11.147336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab9136-9aa8-4a16-b311-24aee534c80f service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:11.158232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 899/1807] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:11.267673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 909/1808] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:11 2022] POST /identity/v3/projects => generated 369 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:11.270719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab9136-9aa8-4a16-b311-24aee534c80f service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:11.285881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab9136-9aa8-4a16-b311-24aee534c80f service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:11.361113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7358f-0a48-4826-946f-c5afaaf9de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:11.362367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7358f-0a48-4826-946f-c5afaaf9de0a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:11.362920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7358f-0a48-4826-946f-c5afaaf9de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:11.363430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7358f-0a48-4826-946f-c5afaaf9de0a admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:11.364771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7358f-0a48-4826-946f-c5afaaf9de0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:11.370266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7358f-0a48-4826-946f-c5afaaf9de0a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:11.498091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 900/1809] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:11 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:11.499927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38736a7f-06f2-4d82-b6ad-26916176a01f admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:11.522850 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38736a7f-06f2-4d82-b6ad-26916176a01f admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:11.535124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0879d4-d84b-4220-a1fd-f7555d7203bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:11.536942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0879d4-d84b-4220-a1fd-f7555d7203bb admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:11.536942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0879d4-d84b-4220-a1fd-f7555d7203bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:11.536942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0879d4-d84b-4220-a1fd-f7555d7203bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:11.537868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0879d4-d84b-4220-a1fd-f7555d7203bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:11.541431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0879d4-d84b-4220-a1fd-f7555d7203bb admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:11.556272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 910/1810] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:11.561348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7358f-0a48-4826-946f-c5afaaf9de0a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:11.575341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7358f-0a48-4826-946f-c5afaaf9de0a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:11.584187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21133f-7671-472a-8a75-e7aa1628e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:11.585182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21133f-7671-472a-8a75-e7aa1628e86b admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:11.585468 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21133f-7671-472a-8a75-e7aa1628e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:11.585821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21133f-7671-472a-8a75-e7aa1628e86b admin admin] PATH_INFO: `/v3/projects/1c22467de2bd4bb39cf04074c2388998/users/148a4fe4b3454722b41f1e3825a5f4e2/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:11.604487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21133f-7671-472a-8a75-e7aa1628e86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c22467de2bd4bb39cf04074c2388998, user_id=148a4fe4b3454722b41f1e3825a5f4e2, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:11.607339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21133f-7671-472a-8a75-e7aa1628e86b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:11.683472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:11.692112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 901/1811] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:11 2022] PUT /identity/v3/projects/1c22467de2bd4bb39cf04074c2388998/users/148a4fe4b3454722b41f1e3825a5f4e2/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:11.697314 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0879d4-d84b-4220-a1fd-f7555d7203bb admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:11.708263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0879d4-d84b-4220-a1fd-f7555d7203bb admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:11.747333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21133f-7671-472a-8a75-e7aa1628e86b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:11.752472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9f21133f-7671-472a-8a75-e7aa1628e86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:11.800021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f0834-1054-4705-9ecb-194a6c0e4f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:11.801838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f0834-1054-4705-9ecb-194a6c0e4f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:11.802612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f0834-1054-4705-9ecb-194a6c0e4f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:11.803480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f0834-1054-4705-9ecb-194a6c0e4f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:11.804538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f0834-1054-4705-9ecb-194a6c0e4f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:11.806908 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f0834-1054-4705-9ecb-194a6c0e4f07 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:11.820974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 911/1812] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:11.825285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f0834-1054-4705-9ecb-194a6c0e4f07 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:11.836736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f0834-1054-4705-9ecb-194a6c0e4f07 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:11.843742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a8e82-90d9-4cf3-92d1-fa14ee190a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:11.844871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a8e82-90d9-4cf3-92d1-fa14ee190a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:11.845260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a8e82-90d9-4cf3-92d1-fa14ee190a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:11.845637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a8e82-90d9-4cf3-92d1-fa14ee190a87 admin admin] PATH_INFO: `/v3/projects/1c22467de2bd4bb39cf04074c2388998/users/148a4fe4b3454722b41f1e3825a5f4e2/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:11.848046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a8e82-90d9-4cf3-92d1-fa14ee190a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c22467de2bd4bb39cf04074c2388998, user_id=148a4fe4b3454722b41f1e3825a5f4e2, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:11.851227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a8e82-90d9-4cf3-92d1-fa14ee190a87 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:11.864496 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 912/1813] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:11 2022] PUT /identity/v3/projects/1c22467de2bd4bb39cf04074c2388998/users/148a4fe4b3454722b41f1e3825a5f4e2/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:11.879108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21133f-7671-472a-8a75-e7aa1628e86b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:11.885227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090816-1610-4a69-a49d-c5d51548c8c6 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:11.885631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090816-1610-4a69-a49d-c5d51548c8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:11.885821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090816-1610-4a69-a49d-c5d51548c8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:11.935758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-80090816-1610-4a69-a49d-c5d51548c8c6 None None] MFA Rules not processed for user `148a4fe4b3454722b41f1e3825a5f4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:11.937581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-80090816-1610-4a69-a49d-c5d51548c8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:11.967698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:11.969117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:11.969476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:11.969822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] PATH_INFO: `/v3/projects/49d78edbadc04ffeb799641933c20923` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:11.971481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d78edbadc04ffeb799641933c20923)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:11.974021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:12.030659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 913/1814] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:11 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:12.042559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80090816-1610-4a69-a49d-c5d51548c8c6 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:12.045650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-80090816-1610-4a69-a49d-c5d51548c8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:12.105721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80090816-1610-4a69-a49d-c5d51548c8c6 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:12.109798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec180f-b65b-44ec-9472-d3696ef1aef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:12.110457 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec180f-b65b-44ec-9472-d3696ef1aef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:12.110742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec180f-b65b-44ec-9472-d3696ef1aef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:12.111018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec180f-b65b-44ec-9472-d3696ef1aef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:12.121580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec180f-b65b-44ec-9472-d3696ef1aef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:12.122988 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec180f-b65b-44ec-9472-d3696ef1aef5 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:12.129160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d78edbadc04ffeb799641933c20923', 'request_id': 'req-cc357467-625f-45bb-bb2b-8acb20e5513c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:12.133100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 914/1815] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:40:12.135717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d78edbadc04ffeb799641933c20923', 'request_id': 'req-cc357467-625f-45bb-bb2b-8acb20e5513c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:12.234479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d78edbadc04ffeb799641933c20923', 'request_id': 'req-cc357467-625f-45bb-bb2b-8acb20e5513c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:12.249195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] The token cache is being invalidate because project 49d78edbadc04ffeb799641933c20923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:12.249712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:12.250368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cc357467-625f-45bb-bb2b-8acb20e5513c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:12.252134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 902/1816] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:11 2022] DELETE /identity/v3/projects/49d78edbadc04ffeb799641933c20923 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:12.257064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa53c3-a892-4211-b523-f087ec1979fa None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:12.257360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa53c3-a892-4211-b523-f087ec1979fa None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:12.258660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa53c3-a892-4211-b523-f087ec1979fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:12.277373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-1aaa53c3-a892-4211-b523-f087ec1979fa None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:12.278584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-1aaa53c3-a892-4211-b523-f087ec1979fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:12.339001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 915/1817] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:12.347481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72dc28-850b-4e80-9c93-7c8377ee1ee1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:12.347766 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72dc28-850b-4e80-9c93-7c8377ee1ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:12.348051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72dc28-850b-4e80-9c93-7c8377ee1ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:12.366604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9e72dc28-850b-4e80-9c93-7c8377ee1ee1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:12.368348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9e72dc28-850b-4e80-9c93-7c8377ee1ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:12.376728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 903/1818] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:12.381161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa53c3-a892-4211-b523-f087ec1979fa None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:12.394652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa53c3-a892-4211-b523-f087ec1979fa None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:12.401008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13a96e-044c-4802-8b79-f415b03d54e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:12.401688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13a96e-044c-4802-8b79-f415b03d54e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:12.401972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13a96e-044c-4802-8b79-f415b03d54e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:12.402298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13a96e-044c-4802-8b79-f415b03d54e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:12.403265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13a96e-044c-4802-8b79-f415b03d54e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:12.403576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13a96e-044c-4802-8b79-f415b03d54e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:12.405239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13a96e-044c-4802-8b79-f415b03d54e6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:12.419532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 916/1819] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:12.425117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72dc28-850b-4e80-9c93-7c8377ee1ee1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:12.435979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72dc28-850b-4e80-9c93-7c8377ee1ee1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:12.441421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e7125-db91-4ac0-aac1-6a7263674f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:12.442164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e7125-db91-4ac0-aac1-6a7263674f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:12.442516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e7125-db91-4ac0-aac1-6a7263674f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:12.442811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e7125-db91-4ac0-aac1-6a7263674f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:12.443572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e7125-db91-4ac0-aac1-6a7263674f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:12.446871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e7125-db91-4ac0-aac1-6a7263674f67 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:12.524408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13a96e-044c-4802-8b79-f415b03d54e6 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:12.526492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-1c13a96e-044c-4802-8b79-f415b03d54e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:12.541095 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13a96e-044c-4802-8b79-f415b03d54e6 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:12.546299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:12.547188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:12.547473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:12.547760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] PATH_INFO: `/v3/users/8ac3ab3be70d4f2fbb0766fad005125c` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:12.549025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac3ab3be70d4f2fbb0766fad005125c)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:12.550942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:13.712956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 904/1820] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:12 2022] POST /identity/v3/projects => generated 377 bytes in 1288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:13.717526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e7125-db91-4ac0-aac1-6a7263674f67 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:13.805484 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e7125-db91-4ac0-aac1-6a7263674f67 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:13.814266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f9705-fa23-41fe-b838-a4e02086250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:13.814266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f9705-fa23-41fe-b838-a4e02086250b admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:13.815197 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f9705-fa23-41fe-b838-a4e02086250b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:13.815777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f9705-fa23-41fe-b838-a4e02086250b admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:13.817177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f9705-fa23-41fe-b838-a4e02086250b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:13.821075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f9705-fa23-41fe-b838-a4e02086250b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:13.865719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac3ab3be70d4f2fbb0766fad005125c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:13.881955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac3ab3be70d4f2fbb0766fad005125c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:13.963486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 905/1821] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:13 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:13.967143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f9705-fa23-41fe-b838-a4e02086250b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:13.979245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f9705-fa23-41fe-b838-a4e02086250b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:13.984629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0f331-612a-4110-895c-f9081b004c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:13.985309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0f331-612a-4110-895c-f9081b004c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:13.985621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0f331-612a-4110-895c-f9081b004c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:13.985884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0f331-612a-4110-895c-f9081b004c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:13.986607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0f331-612a-4110-895c-f9081b004c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:13.988252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0f331-612a-4110-895c-f9081b004c87 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:14.003783 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 906/1822] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:14.006309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac3ab3be70d4f2fbb0766fad005125c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:14.007202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac3ab3be70d4f2fbb0766fad005125c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:14.008821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f0c1fbea-e765-4cb7-83bf-1762b4a31797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac3ab3be70d4f2fbb0766fad005125c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:14.013177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0f331-612a-4110-895c-f9081b004c87 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:14.016333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cfd0f331-612a-4110-895c-f9081b004c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:14.048258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 917/1823] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:12 2022] DELETE /identity/v3/users/8ac3ab3be70d4f2fbb0766fad005125c => generated 0 bytes in 1524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:14.056182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7312-4f87-4483-8646-bf961ea22dd7 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:14.056830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7312-4f87-4483-8646-bf961ea22dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:14.059413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7312-4f87-4483-8646-bf961ea22dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:14.062469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0f331-612a-4110-895c-f9081b004c87 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:14.111767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-e4fc7312-4f87-4483-8646-bf961ea22dd7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:14.113132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e4fc7312-4f87-4483-8646-bf961ea22dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:14.154323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44578b-55d7-4446-9317-d51d6487480f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:14.155001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44578b-55d7-4446-9317-d51d6487480f admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:14.155279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44578b-55d7-4446-9317-d51d6487480f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:14.155686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44578b-55d7-4446-9317-d51d6487480f admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:14.160987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44578b-55d7-4446-9317-d51d6487480f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:14.160987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44578b-55d7-4446-9317-d51d6487480f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:14.173409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 907/1824] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:14.174614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44578b-55d7-4446-9317-d51d6487480f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:14.187861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44578b-55d7-4446-9317-d51d6487480f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:14.194295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0933704-fbaa-4ea8-8388-f62e127ec5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:14.196296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933704-fbaa-4ea8-8388-f62e127ec5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:14.196770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933704-fbaa-4ea8-8388-f62e127ec5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:14.199926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 918/1825] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:14.200098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933704-fbaa-4ea8-8388-f62e127ec5c3 admin admin] PATH_INFO: `/v3/projects/9c45cc57cc244464abd7a1a3b0308102/users/632c8e36e07c477b95a3cc669bd92976/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:14.200196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc7312-4f87-4483-8646-bf961ea22dd7 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:14.200196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e4fc7312-4f87-4483-8646-bf961ea22dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:14.221571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc7312-4f87-4483-8646-bf961ea22dd7 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:14.222933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0933704-fbaa-4ea8-8388-f62e127ec5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c45cc57cc244464abd7a1a3b0308102, user_id=632c8e36e07c477b95a3cc669bd92976, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:14.225939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0933704-fbaa-4ea8-8388-f62e127ec5c3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:14.229119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:14.230629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:14.231220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:14.231625 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] PATH_INFO: `/v3/users/b989465af99b439f96ce71fa17fa89a4` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:14.233123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b989465af99b439f96ce71fa17fa89a4)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:14.235433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:14.304392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 908/1826] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:14 2022] PUT /identity/v3/projects/9c45cc57cc244464abd7a1a3b0308102/users/632c8e36e07c477b95a3cc669bd92976/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:14.309341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0933704-fbaa-4ea8-8388-f62e127ec5c3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:14.311910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f0933704-fbaa-4ea8-8388-f62e127ec5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:14.410565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0933704-fbaa-4ea8-8388-f62e127ec5c3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:14.416812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d193737-1962-4955-af73-b8943072161e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:14.417631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d193737-1962-4955-af73-b8943072161e service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:14.417943 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d193737-1962-4955-af73-b8943072161e service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:14.418186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d193737-1962-4955-af73-b8943072161e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:14.436315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:14.457634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b989465af99b439f96ce71fa17fa89a4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:14.482994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b989465af99b439f96ce71fa17fa89a4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:14.517628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d193737-1962-4955-af73-b8943072161e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:14.519359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d193737-1962-4955-af73-b8943072161e service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:14.536346 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 909/1827] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:14.537715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92176f-a8b9-42f3-be25-0709ff52e3bf None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:14.538788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92176f-a8b9-42f3-be25-0709ff52e3bf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:14.538788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92176f-a8b9-42f3-be25-0709ff52e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:14.566623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b989465af99b439f96ce71fa17fa89a4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:14.568721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b989465af99b439f96ce71fa17fa89a4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:14.572270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d2b5582f-d62f-41bc-924d-2e29f7400e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b989465af99b439f96ce71fa17fa89a4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:14.573145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ae92176f-a8b9-42f3-be25-0709ff52e3bf None None] MFA Rules not processed for user `632c8e36e07c477b95a3cc669bd92976`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:14.574502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ae92176f-a8b9-42f3-be25-0709ff52e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:14.600106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 919/1828] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:14 2022] DELETE /identity/v3/users/b989465af99b439f96ce71fa17fa89a4 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:14.604907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775386b8-4087-44ec-b6f3-0041bfbef52e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:14.605218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775386b8-4087-44ec-b6f3-0041bfbef52e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:14.606090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775386b8-4087-44ec-b6f3-0041bfbef52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:14.628443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-775386b8-4087-44ec-b6f3-0041bfbef52e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:14.631015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-775386b8-4087-44ec-b6f3-0041bfbef52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:14.704436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 920/1829] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:14.715930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 910/1830] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:14.717356 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775386b8-4087-44ec-b6f3-0041bfbef52e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:14.717997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92176f-a8b9-42f3-be25-0709ff52e3bf None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:14.718943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-775386b8-4087-44ec-b6f3-0041bfbef52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:14.720885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ae92176f-a8b9-42f3-be25-0709ff52e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:14.737622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92176f-a8b9-42f3-be25-0709ff52e3bf None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:14.743249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b5b25-d8ac-4254-8d43-a9c36de26bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:14.744115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5b25-d8ac-4254-8d43-a9c36de26bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:14.744473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5b25-d8ac-4254-8d43-a9c36de26bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:14.744816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5b25-d8ac-4254-8d43-a9c36de26bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:14.745642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b5b25-d8ac-4254-8d43-a9c36de26bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:14.747944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b5b25-d8ac-4254-8d43-a9c36de26bf0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:14.778283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775386b8-4087-44ec-b6f3-0041bfbef52e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:14.781628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763faf1d-5604-469b-8e81-ab823c4f5178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:14.782361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763faf1d-5604-469b-8e81-ab823c4f5178 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:14.782556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763faf1d-5604-469b-8e81-ab823c4f5178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:14.782835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763faf1d-5604-469b-8e81-ab823c4f5178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:14.794030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763faf1d-5604-469b-8e81-ab823c4f5178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:14.796748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763faf1d-5604-469b-8e81-ab823c4f5178 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:14.811758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 921/1831] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:14.892576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 911/1832] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:14 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:14.897069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763faf1d-5604-469b-8e81-ab823c4f5178 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:14.908850 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763faf1d-5604-469b-8e81-ab823c4f5178 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:14.979091 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131983d-09d6-4668-b9e9-d0124b99803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:14.979382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131983d-09d6-4668-b9e9-d0124b99803c admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:14.979862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131983d-09d6-4668-b9e9-d0124b99803c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:14.980400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131983d-09d6-4668-b9e9-d0124b99803c admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:14.981204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131983d-09d6-4668-b9e9-d0124b99803c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:14.983527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131983d-09d6-4668-b9e9-d0124b99803c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:15.152361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b5b25-d8ac-4254-8d43-a9c36de26bf0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:15.154776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d40b5b25-d8ac-4254-8d43-a9c36de26bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:15.166356 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 922/1833] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:14 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:15.174345 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131983d-09d6-4668-b9e9-d0124b99803c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:15.176192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b5b25-d8ac-4254-8d43-a9c36de26bf0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:15.187886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:15.189522 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:15.189870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:15.190219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] PATH_INFO: `/v3/projects/ca6c57b87ea54973ad5d22799bcab979` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:15.191660 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6c57b87ea54973ad5d22799bcab979)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:15.193771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:15.209491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131983d-09d6-4668-b9e9-d0124b99803c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:15.248741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b0185-099f-49c0-b1d9-e27ef7a5bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:15.250079 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b0185-099f-49c0-b1d9-e27ef7a5bbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:15.250736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b0185-099f-49c0-b1d9-e27ef7a5bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:15.251316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b0185-099f-49c0-b1d9-e27ef7a5bbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:15.252801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b0185-099f-49c0-b1d9-e27ef7a5bbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:15.255909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b0185-099f-49c0-b1d9-e27ef7a5bbe4 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:15.280218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 923/1834] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:15.284721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b0185-099f-49c0-b1d9-e27ef7a5bbe4 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:15.303835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b0185-099f-49c0-b1d9-e27ef7a5bbe4 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:15.321501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d180e1-f0ea-46e0-a914-791fa3ea3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:15.321501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d180e1-f0ea-46e0-a914-791fa3ea3e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:15.321501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d180e1-f0ea-46e0-a914-791fa3ea3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:15.321501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d180e1-f0ea-46e0-a914-791fa3ea3e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:15.323291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d180e1-f0ea-46e0-a914-791fa3ea3e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:15.323291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d180e1-f0ea-46e0-a914-791fa3ea3e52 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:15.336860 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 924/1835] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:15.341121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d180e1-f0ea-46e0-a914-791fa3ea3e52 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:15.377438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d180e1-f0ea-46e0-a914-791fa3ea3e52 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:15.452650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6c57b87ea54973ad5d22799bcab979', 'request_id': 'req-5a78de15-4f50-4354-b170-76c5291e6ea9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:15.472012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:15.479070 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149526d1-7919-4481-9470-e6a8dc515fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:15.480955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6c57b87ea54973ad5d22799bcab979', 'request_id': 'req-5a78de15-4f50-4354-b170-76c5291e6ea9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:15.488423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149526d1-7919-4481-9470-e6a8dc515fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:15.496479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149526d1-7919-4481-9470-e6a8dc515fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:15.497212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149526d1-7919-4481-9470-e6a8dc515fee admin admin] PATH_INFO: `/v3/projects/0c52393de1bb40889a60545e5bfba8dc/users/3a2c0c7aed7740de9c20a1f8c573bc54/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:15.537163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149526d1-7919-4481-9470-e6a8dc515fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c52393de1bb40889a60545e5bfba8dc, user_id=3a2c0c7aed7740de9c20a1f8c573bc54, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:15.545331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149526d1-7919-4481-9470-e6a8dc515fee admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:15.577348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6c57b87ea54973ad5d22799bcab979', 'request_id': 'req-5a78de15-4f50-4354-b170-76c5291e6ea9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:15.602903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] The token cache is being invalidate because project ca6c57b87ea54973ad5d22799bcab979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:15.603424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:15.604593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:15.607569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 912/1836] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:15 2022] DELETE /identity/v3/projects/ca6c57b87ea54973ad5d22799bcab979 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:15.609610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:15.611297 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:15.647108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78de15-4f50-4354-b170-76c5291e6ea9 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:15.658463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 925/1837] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:15 2022] PUT /identity/v3/projects/0c52393de1bb40889a60545e5bfba8dc/users/3a2c0c7aed7740de9c20a1f8c573bc54/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:15.660051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149526d1-7919-4481-9470-e6a8dc515fee admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:15.668875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-149526d1-7919-4481-9470-e6a8dc515fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:15.781292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149526d1-7919-4481-9470-e6a8dc515fee admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:15.797017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:15.797017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:15.797017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:15.797017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] PATH_INFO: `/v3/users/c44791685c1a4416ad430cb84cf97f40` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:15.797396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44791685c1a4416ad430cb84cf97f40)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:15.797396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:15.814349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:15.815888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:15.816315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:15.816897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] PATH_INFO: `/v3/projects/be8dec5ce948446987a8c88cca8e3127` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:15.818352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8dec5ce948446987a8c88cca8e3127)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:15.821648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:16.131049 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44791685c1a4416ad430cb84cf97f40'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.133475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8dec5ce948446987a8c88cca8e3127', 'request_id': 'req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.139686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8dec5ce948446987a8c88cca8e3127', 'request_id': 'req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.145166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44791685c1a4416ad430cb84cf97f40'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.235481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8dec5ce948446987a8c88cca8e3127', 'request_id': 'req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.251608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] The token cache is being invalidate because project be8dec5ce948446987a8c88cca8e3127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:16.251608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.252389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b57622b4-89e2-4a3a-ac80-329d1c5d1f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.253973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 913/1838] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:15 2022] DELETE /identity/v3/projects/be8dec5ce948446987a8c88cca8e3127 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:16.255203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2448f1-d398-49ee-a214-90e3a54f87b5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:16.255493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2448f1-d398-49ee-a214-90e3a54f87b5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:16.255772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2448f1-d398-49ee-a214-90e3a54f87b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:16.284381 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-cb2448f1-d398-49ee-a214-90e3a54f87b5 None None] MFA Rules not processed for user `3a2c0c7aed7740de9c20a1f8c573bc54`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:16.285594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cb2448f1-d398-49ee-a214-90e3a54f87b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:16.354534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 914/1839] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:16.355931 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2448f1-d398-49ee-a214-90e3a54f87b5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:16.358060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cb2448f1-d398-49ee-a214-90e3a54f87b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:16.367889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44791685c1a4416ad430cb84cf97f40'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.369235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44791685c1a4416ad430cb84cf97f40'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.370048 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44791685c1a4416ad430cb84cf97f40'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.396093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 926/1840] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:15 2022] DELETE /identity/v3/users/c44791685c1a4416ad430cb84cf97f40 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:16.396093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:16.398905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:16.453561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2448f1-d398-49ee-a214-90e3a54f87b5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:16.543096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:16.544019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:16.544339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:16.544671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] PATH_INFO: `/v3/users/afe2673b561340c9825c3ab5bb74551f` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:16.557499 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe2673b561340c9825c3ab5bb74551f)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:16.561458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926b89d-6b91-4abb-83cc-64dd83f007c3 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:16.565415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:16.582999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b1c4-162c-45af-bd44-60245e76987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:16.583774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b1c4-162c-45af-bd44-60245e76987a admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:16.584357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b1c4-162c-45af-bd44-60245e76987a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:16.584863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b1c4-162c-45af-bd44-60245e76987a admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:16.587175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48b1c4-162c-45af-bd44-60245e76987a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:16.590726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48b1c4-162c-45af-bd44-60245e76987a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:16.734951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:16.759227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 927/1841] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:16 2022] POST /identity/v3/projects => generated 379 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:16.761134 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b1c4-162c-45af-bd44-60245e76987a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:16.845039 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe2673b561340c9825c3ab5bb74551f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.877703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe2673b561340c9825c3ab5bb74551f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.924650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b1c4-162c-45af-bd44-60245e76987a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:16.931881 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bae54-8f28-483f-8f9a-b308de194856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:16.932928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bae54-8f28-483f-8f9a-b308de194856 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:16.933317 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bae54-8f28-483f-8f9a-b308de194856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:16.934151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bae54-8f28-483f-8f9a-b308de194856 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:16.936676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bae54-8f28-483f-8f9a-b308de194856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:16.948066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bae54-8f28-483f-8f9a-b308de194856 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:16.972893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe2673b561340c9825c3ab5bb74551f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.973701 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe2673b561340c9825c3ab5bb74551f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.975432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe2673b561340c9825c3ab5bb74551f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:16.997677 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 915/1842] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:16 2022] DELETE /identity/v3/users/afe2673b561340c9825c3ab5bb74551f => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:17.091469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:17.093604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:17.123387 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 928/1843] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:16 2022] POST /identity/v3/users => generated 296 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:17.125013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bae54-8f28-483f-8f9a-b308de194856 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:17.127099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-aa2bae54-8f28-483f-8f9a-b308de194856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:17.158707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bae54-8f28-483f-8f9a-b308de194856 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:17.223429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1127f8d-04b5-4d63-b5bd-e2d50ac6ed78 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:17.232840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:17.233913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.234286 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.234965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] PATH_INFO: `/v3/projects/13dea416746d48d5bf502514fc49e070` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.235900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13dea416746d48d5bf502514fc49e070)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:17.238155 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:17.292474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb67e29-6699-46dc-9cf2-e7a75a217d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:17.293237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67e29-6699-46dc-9cf2-e7a75a217d3e admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.293533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67e29-6699-46dc-9cf2-e7a75a217d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.293895 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67e29-6699-46dc-9cf2-e7a75a217d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.294637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb67e29-6699-46dc-9cf2-e7a75a217d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:17.296355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb67e29-6699-46dc-9cf2-e7a75a217d3e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:17.310233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 929/1844] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:17.311627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb67e29-6699-46dc-9cf2-e7a75a217d3e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:17.323388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb67e29-6699-46dc-9cf2-e7a75a217d3e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:17.329296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de359935-498a-4fef-9e86-d6d408f7d4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:17.330800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359935-498a-4fef-9e86-d6d408f7d4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.331084 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359935-498a-4fef-9e86-d6d408f7d4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.331361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359935-498a-4fef-9e86-d6d408f7d4b6 admin admin] PATH_INFO: `/v3/projects/18c4cb3ecc8f474a8ce5089175738a61/users/20948c3b401c406caa4cdcea7847fa5e/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.355044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de359935-498a-4fef-9e86-d6d408f7d4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c4cb3ecc8f474a8ce5089175738a61, user_id=20948c3b401c406caa4cdcea7847fa5e, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:17.358079 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de359935-498a-4fef-9e86-d6d408f7d4b6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:17.442732 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 930/1845] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:17 2022] PUT /identity/v3/projects/18c4cb3ecc8f474a8ce5089175738a61/users/20948c3b401c406caa4cdcea7847fa5e/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:17.444346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de359935-498a-4fef-9e86-d6d408f7d4b6 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:17.452130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13dea416746d48d5bf502514fc49e070', 'request_id': 'req-6760d0ca-8198-429d-9335-b5e61d404d7e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.458693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13dea416746d48d5bf502514fc49e070', 'request_id': 'req-6760d0ca-8198-429d-9335-b5e61d404d7e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.522519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de359935-498a-4fef-9e86-d6d408f7d4b6 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:17.586631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ba94e-f9a3-4263-aa8d-3d2dfe39e692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:17.587348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ba94e-f9a3-4263-aa8d-3d2dfe39e692 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.587623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ba94e-f9a3-4263-aa8d-3d2dfe39e692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.587944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ba94e-f9a3-4263-aa8d-3d2dfe39e692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.588698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ba94e-f9a3-4263-aa8d-3d2dfe39e692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:17.590394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ba94e-f9a3-4263-aa8d-3d2dfe39e692 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:17.601142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 931/1846] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:17.602561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13dea416746d48d5bf502514fc49e070', 'request_id': 'req-6760d0ca-8198-429d-9335-b5e61d404d7e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.606492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ba94e-f9a3-4263-aa8d-3d2dfe39e692 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:17.616706 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-316ba94e-f9a3-4263-aa8d-3d2dfe39e692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:17.618758 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] The token cache is being invalidate because project 13dea416746d48d5bf502514fc49e070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:17.619115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.619969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.622228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 916/1847] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:17 2022] DELETE /identity/v3/projects/13dea416746d48d5bf502514fc49e070 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:17.622424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ba94e-f9a3-4263-aa8d-3d2dfe39e692 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:17.623254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:17.625307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:17.628940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:17.629833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.630122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.630431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] PATH_INFO: `/v3/users/248ca3449696476e8146a536bb5c263d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.631653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=248ca3449696476e8146a536bb5c263d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:17.634905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:17.640975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760d0ca-8198-429d-9335-b5e61d404d7e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:17.646017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d80e1-4c29-4d8b-91db-a39bb9c2d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:17.647180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d80e1-4c29-4d8b-91db-a39bb9c2d509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.647465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d80e1-4c29-4d8b-91db-a39bb9c2d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.647742 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d80e1-4c29-4d8b-91db-a39bb9c2d509 admin admin] PATH_INFO: `/v3/projects/18c4cb3ecc8f474a8ce5089175738a61/users/20948c3b401c406caa4cdcea7847fa5e/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.650771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d80e1-4c29-4d8b-91db-a39bb9c2d509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c4cb3ecc8f474a8ce5089175738a61, user_id=20948c3b401c406caa4cdcea7847fa5e, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:17.653488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d80e1-4c29-4d8b-91db-a39bb9c2d509 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:17.666234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 917/1848] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:17 2022] PUT /identity/v3/projects/18c4cb3ecc8f474a8ce5089175738a61/users/20948c3b401c406caa4cdcea7847fa5e/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:17.667861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b24baf-aa5d-40ca-8c6c-bb27037236f8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.668263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b24baf-aa5d-40ca-8c6c-bb27037236f8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.668552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b24baf-aa5d-40ca-8c6c-bb27037236f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.690939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-74b24baf-aa5d-40ca-8c6c-bb27037236f8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:17.692241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-74b24baf-aa5d-40ca-8c6c-bb27037236f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:17.766116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 918/1849] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:17.767981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fe37f-a5b8-48a6-ac4a-95205820c14b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.767981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fe37f-a5b8-48a6-ac4a-95205820c14b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.768254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fe37f-a5b8-48a6-ac4a-95205820c14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.799291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a71fe37f-a5b8-48a6-ac4a-95205820c14b None None] MFA Rules not processed for user `20948c3b401c406caa4cdcea7847fa5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:17.800575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a71fe37f-a5b8-48a6-ac4a-95205820c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:17.839572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248ca3449696476e8146a536bb5c263d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.862554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248ca3449696476e8146a536bb5c263d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.884275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 919/1850] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:17.885353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fe37f-a5b8-48a6-ac4a-95205820c14b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:17.886610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a71fe37f-a5b8-48a6-ac4a-95205820c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:17.900764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fe37f-a5b8-48a6-ac4a-95205820c14b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:17.908714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:17.910369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.910936 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.911446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] PATH_INFO: `/v3/projects/1a8fa33d8fd341a78f24940337cabb6c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:17.914459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8fa33d8fd341a78f24940337cabb6c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:17.918183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:17.961381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248ca3449696476e8146a536bb5c263d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.962064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248ca3449696476e8146a536bb5c263d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.962753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-26d24db1-cc8b-4ba2-80b5-4a160f0975c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248ca3449696476e8146a536bb5c263d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:17.979500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 932/1851] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:17 2022] DELETE /identity/v3/users/248ca3449696476e8146a536bb5c263d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:17.981762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cba2c-86cd-48c9-a8c5-d8ca7731daee None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:17.982334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cba2c-86cd-48c9-a8c5-d8ca7731daee None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:17.983082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cba2c-86cd-48c9-a8c5-d8ca7731daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.003143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-cb9cba2c-86cd-48c9-a8c5-d8ca7731daee None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:18.004412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cb9cba2c-86cd-48c9-a8c5-d8ca7731daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.076931 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8fa33d8fd341a78f24940337cabb6c', 'request_id': 'req-85a657e1-887c-4491-b4a9-297b2b931cbc'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:18.087767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8fa33d8fd341a78f24940337cabb6c', 'request_id': 'req-85a657e1-887c-4491-b4a9-297b2b931cbc'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:18.091659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 933/1852] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:18.091659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cba2c-86cd-48c9-a8c5-d8ca7731daee None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:18.092359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cb9cba2c-86cd-48c9-a8c5-d8ca7731daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.144806 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8fa33d8fd341a78f24940337cabb6c', 'request_id': 'req-85a657e1-887c-4491-b4a9-297b2b931cbc'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:18.162389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] The token cache is being invalidate because project 1a8fa33d8fd341a78f24940337cabb6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:18.162909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cba2c-86cd-48c9-a8c5-d8ca7731daee None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:18.163611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:18.165452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-85a657e1-887c-4491-b4a9-297b2b931cbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:18.172356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 920/1853] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:17 2022] DELETE /identity/v3/projects/1a8fa33d8fd341a78f24940337cabb6c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:18.174439 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adfbd4-b276-4d77-a1ac-45b0475514d0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.174735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adfbd4-b276-4d77-a1ac-45b0475514d0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.175020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adfbd4-b276-4d77-a1ac-45b0475514d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.198552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-27adfbd4-b276-4d77-a1ac-45b0475514d0 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:18.201480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-27adfbd4-b276-4d77-a1ac-45b0475514d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.271141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125bd40-d8fe-4cb2-87fe-c75800bae315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:18.272358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125bd40-d8fe-4cb2-87fe-c75800bae315 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.272953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125bd40-d8fe-4cb2-87fe-c75800bae315 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.274098 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125bd40-d8fe-4cb2-87fe-c75800bae315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.281136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5125bd40-d8fe-4cb2-87fe-c75800bae315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.281534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 921/1854] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:18.282214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adfbd4-b276-4d77-a1ac-45b0475514d0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:18.283530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-27adfbd4-b276-4d77-a1ac-45b0475514d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.304012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adfbd4-b276-4d77-a1ac-45b0475514d0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:18.310141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736abc40-5dd8-4b5b-bc44-65379ba4afa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:18.311103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736abc40-5dd8-4b5b-bc44-65379ba4afa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.311541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736abc40-5dd8-4b5b-bc44-65379ba4afa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.311934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736abc40-5dd8-4b5b-bc44-65379ba4afa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.317079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736abc40-5dd8-4b5b-bc44-65379ba4afa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:18.317614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736abc40-5dd8-4b5b-bc44-65379ba4afa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:18.331369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736abc40-5dd8-4b5b-bc44-65379ba4afa3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:18.349617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 922/1855] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:18.352620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84c06-47e8-46bc-944c-cb1f4a1374bf None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.353364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84c06-47e8-46bc-944c-cb1f4a1374bf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.353845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84c06-47e8-46bc-944c-cb1f4a1374bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.370891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:18.384518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-aca84c06-47e8-46bc-944c-cb1f4a1374bf None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:18.386113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-aca84c06-47e8-46bc-944c-cb1f4a1374bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.397399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 923/1856] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:18.400612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84c06-47e8-46bc-944c-cb1f4a1374bf None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:18.402541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-aca84c06-47e8-46bc-944c-cb1f4a1374bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.433816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125bd40-d8fe-4cb2-87fe-c75800bae315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:18.437870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125bd40-d8fe-4cb2-87fe-c75800bae315 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:18.458167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 934/1857] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:18.460202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125bd40-d8fe-4cb2-87fe-c75800bae315 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:18.485367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125bd40-d8fe-4cb2-87fe-c75800bae315 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:18.491878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8919e4-6168-4418-a91d-f3b9d7d82616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:18.492938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8919e4-6168-4418-a91d-f3b9d7d82616 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.493292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8919e4-6168-4418-a91d-f3b9d7d82616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.500950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8919e4-6168-4418-a91d-f3b9d7d82616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.500950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8919e4-6168-4418-a91d-f3b9d7d82616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:18.500950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8919e4-6168-4418-a91d-f3b9d7d82616 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:18.528442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84c06-47e8-46bc-944c-cb1f4a1374bf None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:18.535039 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4f2c6-dd12-41bc-a21c-e32c4ea24a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:18.536198 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4f2c6-dd12-41bc-a21c-e32c4ea24a7e service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.536709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4f2c6-dd12-41bc-a21c-e32c4ea24a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.537216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4f2c6-dd12-41bc-a21c-e32c4ea24a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.559812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4f2c6-dd12-41bc-a21c-e32c4ea24a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:18.561210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4f2c6-dd12-41bc-a21c-e32c4ea24a7e service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:18.581213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 924/1858] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:18.586780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc73c5-22c3-453c-9c9f-e8553e9b1f54 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.586780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc73c5-22c3-453c-9c9f-e8553e9b1f54 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.586780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc73c5-22c3-453c-9c9f-e8553e9b1f54 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.590111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 925/1859] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:40:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:40:18.593753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb588a-5af6-4848-9782-5e13c747da3d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.594164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb588a-5af6-4848-9782-5e13c747da3d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.594639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb588a-5af6-4848-9782-5e13c747da3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.626306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 935/1860] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:18 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:18.639389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c2cb588a-5af6-4848-9782-5e13c747da3d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:18.639389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c2cb588a-5af6-4848-9782-5e13c747da3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.639815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c0275-39f6-4005-9990-c0e2e632828e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.639815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c0275-39f6-4005-9990-c0e2e632828e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.639815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c0275-39f6-4005-9990-c0e2e632828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.704174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-594c0275-39f6-4005-9990-c0e2e632828e None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:18.706062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-594c0275-39f6-4005-9990-c0e2e632828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.714897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 926/1861] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:18.719275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb588a-5af6-4848-9782-5e13c747da3d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:18.729925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb588a-5af6-4848-9782-5e13c747da3d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:18.735174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f5f83-c6ca-4b34-81a9-472302459c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:18.735861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5f83-c6ca-4b34-81a9-472302459c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.736182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5f83-c6ca-4b34-81a9-472302459c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.736463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5f83-c6ca-4b34-81a9-472302459c7a admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.737326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f5f83-c6ca-4b34-81a9-472302459c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:18.739319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f5f83-c6ca-4b34-81a9-472302459c7a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:18.811846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:18.850360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 936/1862] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:40:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:18.852245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c0275-39f6-4005-9990-c0e2e632828e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:18.859808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 927/1863] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:18 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:18.860759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f5f83-c6ca-4b34-81a9-472302459c7a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:18.871457 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-594c0275-39f6-4005-9990-c0e2e632828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.876530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f5f83-c6ca-4b34-81a9-472302459c7a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:18.881653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a4b0-a148-4462-b8c1-229d1cf83bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:18.882398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a4b0-a148-4462-b8c1-229d1cf83bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.883347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a4b0-a148-4462-b8c1-229d1cf83bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.883638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a4b0-a148-4462-b8c1-229d1cf83bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.884876 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a4b0-a148-4462-b8c1-229d1cf83bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:18.885446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a4b0-a148-4462-b8c1-229d1cf83bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:18.886855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a4b0-a148-4462-b8c1-229d1cf83bc9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:18.906610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 928/1864] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:18.906610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a4b0-a148-4462-b8c1-229d1cf83bc9 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:18.923889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a4b0-a148-4462-b8c1-229d1cf83bc9 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:18.933916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1caafa-6c10-43e9-990f-5af472d69f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:18.933916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1caafa-6c10-43e9-990f-5af472d69f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.933916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1caafa-6c10-43e9-990f-5af472d69f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.934462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1caafa-6c10-43e9-990f-5af472d69f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.935183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1caafa-6c10-43e9-990f-5af472d69f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:18.937307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1caafa-6c10-43e9-990f-5af472d69f09 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:18.969390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c0275-39f6-4005-9990-c0e2e632828e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:18.971363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 929/1865] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:18.972970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1caafa-6c10-43e9-990f-5af472d69f09 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:18.979727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93934545-6219-45a4-bd06-81af8b121f92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:18.980564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93934545-6219-45a4-bd06-81af8b121f92 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:18.981045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93934545-6219-45a4-bd06-81af8b121f92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:18.981906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93934545-6219-45a4-bd06-81af8b121f92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:18.983609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-93934545-6219-45a4-bd06-81af8b121f92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:18.992968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1caafa-6c10-43e9-990f-5af472d69f09 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.013595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ffc1e-80b3-4648-9104-4f1e3b338a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.015183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ffc1e-80b3-4648-9104-4f1e3b338a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.026719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ffc1e-80b3-4648-9104-4f1e3b338a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.027220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ffc1e-80b3-4648-9104-4f1e3b338a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.028829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ffc1e-80b3-4648-9104-4f1e3b338a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.036399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ffc1e-80b3-4648-9104-4f1e3b338a07 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.106246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93934545-6219-45a4-bd06-81af8b121f92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.107831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93934545-6219-45a4-bd06-81af8b121f92 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.119645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 937/1866] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:19.120814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93934545-6219-45a4-bd06-81af8b121f92 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.134706 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93934545-6219-45a4-bd06-81af8b121f92 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.140649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581d3c5-9d64-4e4b-8aec-20f4ad844e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.144329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581d3c5-9d64-4e4b-8aec-20f4ad844e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.144329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581d3c5-9d64-4e4b-8aec-20f4ad844e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.144329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581d3c5-9d64-4e4b-8aec-20f4ad844e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.144329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581d3c5-9d64-4e4b-8aec-20f4ad844e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.144985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581d3c5-9d64-4e4b-8aec-20f4ad844e92 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.157754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 938/1867] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:19.160965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581d3c5-9d64-4e4b-8aec-20f4ad844e92 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.160965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7581d3c5-9d64-4e4b-8aec-20f4ad844e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:19.180437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581d3c5-9d64-4e4b-8aec-20f4ad844e92 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.187110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d017e3-7ab7-44b5-a3d5-a52f80171c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.187110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d017e3-7ab7-44b5-a3d5-a52f80171c5a service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.187437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d017e3-7ab7-44b5-a3d5-a52f80171c5a service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.187437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d017e3-7ab7-44b5-a3d5-a52f80171c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.198130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d017e3-7ab7-44b5-a3d5-a52f80171c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.199715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d017e3-7ab7-44b5-a3d5-a52f80171c5a service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.211842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 939/1868] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:19.212777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d017e3-7ab7-44b5-a3d5-a52f80171c5a service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.223610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d017e3-7ab7-44b5-a3d5-a52f80171c5a service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.228870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26f051-429b-4c70-8c44-bcafaba6fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.229815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f051-429b-4c70-8c44-bcafaba6fd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.230097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f051-429b-4c70-8c44-bcafaba6fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.230430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f051-429b-4c70-8c44-bcafaba6fd81 admin admin] PATH_INFO: `/v3/projects/771d3d693cf24a3ea665acbbcd1b94ae/users/b51cc916e4264bbdb09eb20f804ee876/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.285120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 930/1869] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:18 2022] POST /identity/v3/projects => generated 387 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:19.291202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ffc1e-80b3-4648-9104-4f1e3b338a07 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.296388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-be7ffc1e-80b3-4648-9104-4f1e3b338a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:19.382882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26f051-429b-4c70-8c44-bcafaba6fd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771d3d693cf24a3ea665acbbcd1b94ae, user_id=b51cc916e4264bbdb09eb20f804ee876, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.385745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26f051-429b-4c70-8c44-bcafaba6fd81 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.415162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ffc1e-80b3-4648-9104-4f1e3b338a07 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.420694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.421879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.422580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.422966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] PATH_INFO: `/v3/projects/ac9a1ecf8d00436f8d1c3f84d3463ce7` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.424532 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9a1ecf8d00436f8d1c3f84d3463ce7)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.426530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.499362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 940/1870] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:19 2022] PUT /identity/v3/projects/771d3d693cf24a3ea665acbbcd1b94ae/users/b51cc916e4264bbdb09eb20f804ee876/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:19.501846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26f051-429b-4c70-8c44-bcafaba6fd81 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.534793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9a1ecf8d00436f8d1c3f84d3463ce7', 'request_id': 'req-5ed70229-c7e2-4365-96de-59dda7b8d93a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:19.541867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9a1ecf8d00436f8d1c3f84d3463ce7', 'request_id': 'req-5ed70229-c7e2-4365-96de-59dda7b8d93a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:19.574608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26f051-429b-4c70-8c44-bcafaba6fd81 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.635701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a365ef7-4832-471b-9c3b-cbacbd6c8ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.636414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a365ef7-4832-471b-9c3b-cbacbd6c8ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.636703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a365ef7-4832-471b-9c3b-cbacbd6c8ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.636981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a365ef7-4832-471b-9c3b-cbacbd6c8ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.637672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a365ef7-4832-471b-9c3b-cbacbd6c8ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.639612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a365ef7-4832-471b-9c3b-cbacbd6c8ba6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.677221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9a1ecf8d00436f8d1c3f84d3463ce7', 'request_id': 'req-5ed70229-c7e2-4365-96de-59dda7b8d93a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:19.697612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] The token cache is being invalidate because project ac9a1ecf8d00436f8d1c3f84d3463ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:19.698091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:19.699090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ed70229-c7e2-4365-96de-59dda7b8d93a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:19.701869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 931/1871] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:19 2022] DELETE /identity/v3/projects/ac9a1ecf8d00436f8d1c3f84d3463ce7 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:19.704089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e3e19-bcff-48e0-b915-47796ddcfeda None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.704586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e3e19-bcff-48e0-b915-47796ddcfeda None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.705077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e3e19-bcff-48e0-b915-47796ddcfeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.743231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0f9e3e19-bcff-48e0-b915-47796ddcfeda None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:19.749920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0f9e3e19-bcff-48e0-b915-47796ddcfeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:19.763437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 932/1872] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:19.764256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e3e19-bcff-48e0-b915-47796ddcfeda None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.766017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0f9e3e19-bcff-48e0-b915-47796ddcfeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:19.779752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e3e19-bcff-48e0-b915-47796ddcfeda None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.784946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.785830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.786123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.786417 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] PATH_INFO: `/v3/users/148a4fe4b3454722b41f1e3825a5f4e2` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.787613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=148a4fe4b3454722b41f1e3825a5f4e2)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.794494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 941/1873] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:19 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:19.794494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a365ef7-4832-471b-9c3b-cbacbd6c8ba6 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.794771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.798008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3a365ef7-4832-471b-9c3b-cbacbd6c8ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:19.871333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a365ef7-4832-471b-9c3b-cbacbd6c8ba6 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.875549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73ca93-bd71-488c-bdd8-16ca16d6d636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.876871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73ca93-bd71-488c-bdd8-16ca16d6d636 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.877149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73ca93-bd71-488c-bdd8-16ca16d6d636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.877711 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73ca93-bd71-488c-bdd8-16ca16d6d636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.888779 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73ca93-bd71-488c-bdd8-16ca16d6d636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.890341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73ca93-bd71-488c-bdd8-16ca16d6d636 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.901381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 942/1874] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:19.905471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73ca93-bd71-488c-bdd8-16ca16d6d636 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.907219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cc73ca93-bd71-488c-bdd8-16ca16d6d636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:19.923363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73ca93-bd71-488c-bdd8-16ca16d6d636 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.928618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0c44d-1515-4ab0-9a38-0bba22fc811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.929336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0c44d-1515-4ab0-9a38-0bba22fc811a admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.929606 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0c44d-1515-4ab0-9a38-0bba22fc811a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.929884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0c44d-1515-4ab0-9a38-0bba22fc811a admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.930732 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0c44d-1515-4ab0-9a38-0bba22fc811a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.932338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0c44d-1515-4ab0-9a38-0bba22fc811a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.943480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 943/1875] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:19.947553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0c44d-1515-4ab0-9a38-0bba22fc811a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.959028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0c44d-1515-4ab0-9a38-0bba22fc811a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:19.964479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07903925-0843-4f5d-89a8-b906c1529bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:19.965149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07903925-0843-4f5d-89a8-b906c1529bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:19.965434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07903925-0843-4f5d-89a8-b906c1529bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:19.965707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07903925-0843-4f5d-89a8-b906c1529bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:19.966430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07903925-0843-4f5d-89a8-b906c1529bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:19.968086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07903925-0843-4f5d-89a8-b906c1529bc3 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:19.984304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 944/1876] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:19.985063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07903925-0843-4f5d-89a8-b906c1529bc3 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:19.996007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07903925-0843-4f5d-89a8-b906c1529bc3 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.013973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219f222-fdb3-436d-8a0e-76119bf054fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.015580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f222-fdb3-436d-8a0e-76119bf054fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.016009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f222-fdb3-436d-8a0e-76119bf054fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.016307 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f222-fdb3-436d-8a0e-76119bf054fb admin admin] PATH_INFO: `/v3/projects/01658b1563e5472a8e4dfb6b3ad2412d/users/d1ecfb6995bd48ad8ba93af04baa7e19/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.026739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148a4fe4b3454722b41f1e3825a5f4e2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:20.042059 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148a4fe4b3454722b41f1e3825a5f4e2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:20.057169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219f222-fdb3-436d-8a0e-76119bf054fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=01658b1563e5472a8e4dfb6b3ad2412d, user_id=d1ecfb6995bd48ad8ba93af04baa7e19, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.059900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219f222-fdb3-436d-8a0e-76119bf054fb admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.178730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148a4fe4b3454722b41f1e3825a5f4e2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:20.179446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148a4fe4b3454722b41f1e3825a5f4e2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:20.180454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148a4fe4b3454722b41f1e3825a5f4e2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:20.185799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 945/1877] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:19 2022] PUT /identity/v3/projects/01658b1563e5472a8e4dfb6b3ad2412d/users/d1ecfb6995bd48ad8ba93af04baa7e19/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:20.197498 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279979-15eb-4ffe-96d1-3c33653541d9 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.197839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279979-15eb-4ffe-96d1-3c33653541d9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.198074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279979-15eb-4ffe-96d1-3c33653541d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.206364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 933/1878] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:19 2022] DELETE /identity/v3/users/148a4fe4b3454722b41f1e3825a5f4e2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:20.272585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-18279979-15eb-4ffe-96d1-3c33653541d9 None None] MFA Rules not processed for user `d1ecfb6995bd48ad8ba93af04baa7e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:20.275196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-18279979-15eb-4ffe-96d1-3c33653541d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:20.378622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 946/1879] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:20.381645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.383459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:20.470847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d796776-cba4-4b23-b842-4a1fcdf7a1e9 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.475819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499b69-9097-4fcd-8e93-0eb2f9a2309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.476861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499b69-9097-4fcd-8e93-0eb2f9a2309a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.477485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499b69-9097-4fcd-8e93-0eb2f9a2309a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.478287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc499b69-9097-4fcd-8e93-0eb2f9a2309a admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.479162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc499b69-9097-4fcd-8e93-0eb2f9a2309a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.481272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc499b69-9097-4fcd-8e93-0eb2f9a2309a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.567752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 934/1880] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:20 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:20.573690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18279979-15eb-4ffe-96d1-3c33653541d9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.590533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18279979-15eb-4ffe-96d1-3c33653541d9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.687816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a0af9-52c8-48f8-820a-db2271138057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.688645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a0af9-52c8-48f8-820a-db2271138057 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.689342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a0af9-52c8-48f8-820a-db2271138057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.689342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a0af9-52c8-48f8-820a-db2271138057 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.689880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a0af9-52c8-48f8-820a-db2271138057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.703785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a0af9-52c8-48f8-820a-db2271138057 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.791857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499b69-9097-4fcd-8e93-0eb2f9a2309a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.792996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 947/1881] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:20 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:20.794907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fc499b69-9097-4fcd-8e93-0eb2f9a2309a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:20.797269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a0af9-52c8-48f8-820a-db2271138057 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.808999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a0af9-52c8-48f8-820a-db2271138057 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.814622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e87d2e-3140-4f59-80e5-1004831ab512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.814869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87d2e-3140-4f59-80e5-1004831ab512 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.815263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87d2e-3140-4f59-80e5-1004831ab512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.815561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87d2e-3140-4f59-80e5-1004831ab512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.816352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e87d2e-3140-4f59-80e5-1004831ab512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.818081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e87d2e-3140-4f59-80e5-1004831ab512 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.820633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc499b69-9097-4fcd-8e93-0eb2f9a2309a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.828044 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.829443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.829953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.830287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] PATH_INFO: `/v3/projects/1c22467de2bd4bb39cf04074c2388998` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.830890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 948/1882] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:20.831617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c22467de2bd4bb39cf04074c2388998)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.835035 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e87d2e-3140-4f59-80e5-1004831ab512 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:20.843493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:20.847039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e87d2e-3140-4f59-80e5-1004831ab512 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:20.852326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7429e-582c-4ba7-9d8f-902727de1845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:20.853319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7429e-582c-4ba7-9d8f-902727de1845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:20.853609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7429e-582c-4ba7-9d8f-902727de1845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:20.853898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7429e-582c-4ba7-9d8f-902727de1845 admin admin] PATH_INFO: `/v3/projects/070edde96d0a44bc8a89fd18d6214c02/users/c9013ab7880140298b4b5352524385b2/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:20.870331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7429e-582c-4ba7-9d8f-902727de1845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070edde96d0a44bc8a89fd18d6214c02, user_id=c9013ab7880140298b4b5352524385b2, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:20.873064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7429e-582c-4ba7-9d8f-902727de1845 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:21.004975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 949/1883] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:20 2022] PUT /identity/v3/projects/070edde96d0a44bc8a89fd18d6214c02/users/c9013ab7880140298b4b5352524385b2/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:21.006000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7429e-582c-4ba7-9d8f-902727de1845 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:21.010404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c22467de2bd4bb39cf04074c2388998', 'request_id': 'req-93e210b6-b137-48f1-9faa-57cd60e77411'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:21.017614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c22467de2bd4bb39cf04074c2388998', 'request_id': 'req-93e210b6-b137-48f1-9faa-57cd60e77411'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:21.081358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7429e-582c-4ba7-9d8f-902727de1845 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:21.151929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3169b3-c5fe-463f-9dbd-9a491de4d1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:21.152754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3169b3-c5fe-463f-9dbd-9a491de4d1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.153354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3169b3-c5fe-463f-9dbd-9a491de4d1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.153463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3169b3-c5fe-463f-9dbd-9a491de4d1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.154396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3169b3-c5fe-463f-9dbd-9a491de4d1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:21.156100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3169b3-c5fe-463f-9dbd-9a491de4d1c7 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:21.167678 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c22467de2bd4bb39cf04074c2388998', 'request_id': 'req-93e210b6-b137-48f1-9faa-57cd60e77411'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:21.171787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 950/1884] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:21.176286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3169b3-c5fe-463f-9dbd-9a491de4d1c7 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:21.189804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3169b3-c5fe-463f-9dbd-9a491de4d1c7 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:21.190441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] The token cache is being invalidate because project 1c22467de2bd4bb39cf04074c2388998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:21.190441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:21.191098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93e210b6-b137-48f1-9faa-57cd60e77411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:21.194168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 935/1885] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:20 2022] DELETE /identity/v3/projects/1c22467de2bd4bb39cf04074c2388998 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:21.196335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3eb73e-8825-45e9-b750-4e4cda4dcd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:21.197430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eb73e-8825-45e9-b750-4e4cda4dcd89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.197933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eb73e-8825-45e9-b750-4e4cda4dcd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.199124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eb73e-8825-45e9-b750-4e4cda4dcd89 admin admin] PATH_INFO: `/v3/projects/070edde96d0a44bc8a89fd18d6214c02/users/c9013ab7880140298b4b5352524385b2/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.199426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5209d0-47e0-4056-8951-2a1b8f23e0f2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.199718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5209d0-47e0-4056-8951-2a1b8f23e0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.199998 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5209d0-47e0-4056-8951-2a1b8f23e0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.202116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3eb73e-8825-45e9-b750-4e4cda4dcd89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070edde96d0a44bc8a89fd18d6214c02, user_id=c9013ab7880140298b4b5352524385b2, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:21.205070 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3eb73e-8825-45e9-b750-4e4cda4dcd89 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:21.219158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-4f5209d0-47e0-4056-8951-2a1b8f23e0f2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:21.220463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4f5209d0-47e0-4056-8951-2a1b8f23e0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:21.224125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 951/1886] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:21 2022] PUT /identity/v3/projects/070edde96d0a44bc8a89fd18d6214c02/users/c9013ab7880140298b4b5352524385b2/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:21.236049 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadae5d6-12e7-4549-8319-67932eb3e3c4 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.237186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadae5d6-12e7-4549-8319-67932eb3e3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.238038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadae5d6-12e7-4549-8319-67932eb3e3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.303494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-cadae5d6-12e7-4549-8319-67932eb3e3c4 None None] MFA Rules not processed for user `c9013ab7880140298b4b5352524385b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:21.307808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:21.308749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cadae5d6-12e7-4549-8319-67932eb3e3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:21.314248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 936/1887] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:21.315837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b9f50-c833-4301-bfc7-8328185e1ca6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.316109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b9f50-c833-4301-bfc7-8328185e1ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.316391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b9f50-c833-4301-bfc7-8328185e1ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.339728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5d1b9f50-c833-4301-bfc7-8328185e1ca6 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:21.341709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5d1b9f50-c833-4301-bfc7-8328185e1ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:21.360126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 937/1888] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:21.362038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b9f50-c833-4301-bfc7-8328185e1ca6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:21.376240 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b9f50-c833-4301-bfc7-8328185e1ca6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:21.381818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd59ab5-886f-4c4c-962f-97e9611c0f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:21.383711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd59ab5-886f-4c4c-962f-97e9611c0f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.384233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd59ab5-886f-4c4c-962f-97e9611c0f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.384575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd59ab5-886f-4c4c-962f-97e9611c0f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.385341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd59ab5-886f-4c4c-962f-97e9611c0f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:21.385664 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd59ab5-886f-4c4c-962f-97e9611c0f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:21.387254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd59ab5-886f-4c4c-962f-97e9611c0f03 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:21.409156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 938/1889] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:21.413276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 952/1890] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:21.418362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd59ab5-886f-4c4c-962f-97e9611c0f03 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:21.425115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadae5d6-12e7-4549-8319-67932eb3e3c4 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:21.426632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cadae5d6-12e7-4549-8319-67932eb3e3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:21.435212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd59ab5-886f-4c4c-962f-97e9611c0f03 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:21.441219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95641b8d-7df0-43d7-96cb-51b8c2a70bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:21.442008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95641b8d-7df0-43d7-96cb-51b8c2a70bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.442352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95641b8d-7df0-43d7-96cb-51b8c2a70bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.442694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95641b8d-7df0-43d7-96cb-51b8c2a70bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.444119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95641b8d-7df0-43d7-96cb-51b8c2a70bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:21.446685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95641b8d-7df0-43d7-96cb-51b8c2a70bc4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:21.519605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadae5d6-12e7-4549-8319-67932eb3e3c4 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:21.532470 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712db318-daca-4f8d-ae32-4d01cd4b16e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:21.534420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712db318-daca-4f8d-ae32-4d01cd4b16e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.534420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712db318-daca-4f8d-ae32-4d01cd4b16e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.534902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712db318-daca-4f8d-ae32-4d01cd4b16e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.566396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 939/1891] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:21 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:21.581352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95641b8d-7df0-43d7-96cb-51b8c2a70bc4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:21.598674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712db318-daca-4f8d-ae32-4d01cd4b16e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:21.604489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712db318-daca-4f8d-ae32-4d01cd4b16e0 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:21.629992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 953/1892] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:40:21.676428 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712db318-daca-4f8d-ae32-4d01cd4b16e0 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:21.683692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-712db318-daca-4f8d-ae32-4d01cd4b16e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:21.706644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712db318-daca-4f8d-ae32-4d01cd4b16e0 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:21.726020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:21.727762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:21.728765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.729734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.730114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] PATH_INFO: `/v3/users/d1ecfb6995bd48ad8ba93af04baa7e19` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.735608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ecfb6995bd48ad8ba93af04baa7e19)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:21.735608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:21.736560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95641b8d-7df0-43d7-96cb-51b8c2a70bc4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:21.744957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bf890-d96c-4630-9933-3eb6da5631a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:21.746152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bf890-d96c-4630-9933-3eb6da5631a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.746642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bf890-d96c-4630-9933-3eb6da5631a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.747424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bf890-d96c-4630-9933-3eb6da5631a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.748822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bf890-d96c-4630-9933-3eb6da5631a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:21.752574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bf890-d96c-4630-9933-3eb6da5631a8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:21.896798 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 940/1893] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:21 2022] POST /identity/v3/users => generated 289 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:21.896798 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3fca-6e7c-4c5b-8dff-0c3bc2675bbb None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:21.896798 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3fca-6e7c-4c5b-8dff-0c3bc2675bbb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:21.896798 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3fca-6e7c-4c5b-8dff-0c3bc2675bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:21.924816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9e2f3fca-6e7c-4c5b-8dff-0c3bc2675bbb None None] MFA Rules not processed for user `b51cc916e4264bbdb09eb20f804ee876`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:21.926066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9e2f3fca-6e7c-4c5b-8dff-0c3bc2675bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:21.941106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ecfb6995bd48ad8ba93af04baa7e19'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:21.954424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ecfb6995bd48ad8ba93af04baa7e19'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:21.993454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 941/1894] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:21.994333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f3fca-6e7c-4c5b-8dff-0c3bc2675bbb None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.004608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f3fca-6e7c-4c5b-8dff-0c3bc2675bbb None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:22.009788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451cf74-9bfc-4742-8f0d-04dc12fe5864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:22.010470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451cf74-9bfc-4742-8f0d-04dc12fe5864 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.010757 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451cf74-9bfc-4742-8f0d-04dc12fe5864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.011037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451cf74-9bfc-4742-8f0d-04dc12fe5864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.011799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451cf74-9bfc-4742-8f0d-04dc12fe5864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:22.013491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451cf74-9bfc-4742-8f0d-04dc12fe5864 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:22.028613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 942/1895] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:22.028613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451cf74-9bfc-4742-8f0d-04dc12fe5864 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.028613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a451cf74-9bfc-4742-8f0d-04dc12fe5864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:22.041024 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451cf74-9bfc-4742-8f0d-04dc12fe5864 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:22.045697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e3648-9107-4fd4-a6ba-cc2ee6890210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:22.046455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3648-9107-4fd4-a6ba-cc2ee6890210 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.046642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3648-9107-4fd4-a6ba-cc2ee6890210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.046922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3648-9107-4fd4-a6ba-cc2ee6890210 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.047730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e3648-9107-4fd4-a6ba-cc2ee6890210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:22.050169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e3648-9107-4fd4-a6ba-cc2ee6890210 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:22.098230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ecfb6995bd48ad8ba93af04baa7e19'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:22.098874 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ecfb6995bd48ad8ba93af04baa7e19'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:22.099570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ecfb6995bd48ad8ba93af04baa7e19'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:22.113623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 954/1896] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:21 2022] DELETE /identity/v3/users/d1ecfb6995bd48ad8ba93af04baa7e19 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:22.114450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.115777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:22.186082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9667559-f5e5-4c6c-be20-23406ad9ac29 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:22.191065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32b3a4-2fab-4d7f-a4a0-6f72383258e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:22.191904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b3a4-2fab-4d7f-a4a0-6f72383258e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.192302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b3a4-2fab-4d7f-a4a0-6f72383258e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.192620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b3a4-2fab-4d7f-a4a0-6f72383258e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.193392 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32b3a4-2fab-4d7f-a4a0-6f72383258e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:22.195134 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32b3a4-2fab-4d7f-a4a0-6f72383258e8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:22.200149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 943/1897] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:22 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:22.201860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e8096-f8ab-4539-9952-c3b680c864cd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.202222 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e8096-f8ab-4539-9952-c3b680c864cd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.202514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e8096-f8ab-4539-9952-c3b680c864cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.208998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 955/1898] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:22.209875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32b3a4-2fab-4d7f-a4a0-6f72383258e8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.213828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-bf32b3a4-2fab-4d7f-a4a0-6f72383258e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:22.228619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32b3a4-2fab-4d7f-a4a0-6f72383258e8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:22.230759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5b1e8096-f8ab-4539-9952-c3b680c864cd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:22.231992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5b1e8096-f8ab-4539-9952-c3b680c864cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:22.300465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cd941-aca6-4a11-bcd1-5ff5b1720782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:22.301254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cd941-aca6-4a11-bcd1-5ff5b1720782 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.301612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cd941-aca6-4a11-bcd1-5ff5b1720782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.302002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cd941-aca6-4a11-bcd1-5ff5b1720782 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.302877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cd941-aca6-4a11-bcd1-5ff5b1720782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:22.306382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cd941-aca6-4a11-bcd1-5ff5b1720782 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:22.313957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 944/1899] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:22.315013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e8096-f8ab-4539-9952-c3b680c864cd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.327493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e8096-f8ab-4539-9952-c3b680c864cd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:22.332648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc58c80-22b6-475d-9b77-1ccfb1a60c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:22.333860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc58c80-22b6-475d-9b77-1ccfb1a60c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.334128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc58c80-22b6-475d-9b77-1ccfb1a60c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.334405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc58c80-22b6-475d-9b77-1ccfb1a60c61 admin admin] PATH_INFO: `/v3/projects/fdee7590a6d745f181a500bd3b3f6e43/users/8150ca40b3264dc7a67b7af140583ccd/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.351133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc58c80-22b6-475d-9b77-1ccfb1a60c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdee7590a6d745f181a500bd3b3f6e43, user_id=8150ca40b3264dc7a67b7af140583ccd, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:22.354618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc58c80-22b6-475d-9b77-1ccfb1a60c61 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:22.439191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 945/1901] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:22 2022] PUT /identity/v3/projects/fdee7590a6d745f181a500bd3b3f6e43/users/8150ca40b3264dc7a67b7af140583ccd/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:22.439499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 956/1901] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:22 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:22.440301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cd941-aca6-4a11-bcd1-5ff5b1720782 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.442917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc58c80-22b6-475d-9b77-1ccfb1a60c61 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.447641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4a1cd941-aca6-4a11-bcd1-5ff5b1720782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:22.553148 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cd941-aca6-4a11-bcd1-5ff5b1720782 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:22.639021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc58c80-22b6-475d-9b77-1ccfb1a60c61 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:22.654110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7393f-103c-4584-a7af-d7745dac07a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:22.654110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7393f-103c-4584-a7af-d7745dac07a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.654110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7393f-103c-4584-a7af-d7745dac07a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.654110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7393f-103c-4584-a7af-d7745dac07a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.657169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7393f-103c-4584-a7af-d7745dac07a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:22.657255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7393f-103c-4584-a7af-d7745dac07a7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:22.660800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf6c5a-8541-4358-a5ec-fb9e6d1d510b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:22.661653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf6c5a-8541-4358-a5ec-fb9e6d1d510b service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.662117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf6c5a-8541-4358-a5ec-fb9e6d1d510b service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.662664 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf6c5a-8541-4358-a5ec-fb9e6d1d510b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.671154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 946/1902] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:22.672830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9275f8-d02c-4451-ac1a-9aca9a5a40fa None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.673118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9275f8-d02c-4451-ac1a-9aca9a5a40fa None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.673424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9275f8-d02c-4451-ac1a-9aca9a5a40fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.677066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf6c5a-8541-4358-a5ec-fb9e6d1d510b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:22.678780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf6c5a-8541-4358-a5ec-fb9e6d1d510b service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:22.691089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 957/1903] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:22.692047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf6c5a-8541-4358-a5ec-fb9e6d1d510b service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.704790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf6c5a-8541-4358-a5ec-fb9e6d1d510b service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:22.711965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e706f91-c03c-4298-8774-82eb0481497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:22.713140 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e706f91-c03c-4298-8774-82eb0481497d admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.713538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e706f91-c03c-4298-8774-82eb0481497d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.713933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e706f91-c03c-4298-8774-82eb0481497d admin admin] PATH_INFO: `/v3/projects/4ed5e923497f42c3ade5cd9f849f737e/users/8cca91079e684084a2ee22d5130b39a6/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.722375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9f9275f8-d02c-4451-ac1a-9aca9a5a40fa None None] MFA Rules not processed for user `8150ca40b3264dc7a67b7af140583ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:22.724042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9f9275f8-d02c-4451-ac1a-9aca9a5a40fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:22.771088 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e706f91-c03c-4298-8774-82eb0481497d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed5e923497f42c3ade5cd9f849f737e, user_id=8cca91079e684084a2ee22d5130b39a6, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:22.781252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e706f91-c03c-4298-8774-82eb0481497d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:22.819198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:22.832813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 947/1904] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:22.834338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9275f8-d02c-4451-ac1a-9aca9a5a40fa None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.846859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9275f8-d02c-4451-ac1a-9aca9a5a40fa None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:22.852531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e0a0-22de-4a41-91cd-190b2897f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:22.853211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e0a0-22de-4a41-91cd-190b2897f544 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:22.853495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e0a0-22de-4a41-91cd-190b2897f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:22.853774 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e0a0-22de-4a41-91cd-190b2897f544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:22.854633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09e0a0-22de-4a41-91cd-190b2897f544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:22.856898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09e0a0-22de-4a41-91cd-190b2897f544 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:22.881411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 958/1905] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:22 2022] PUT /identity/v3/projects/4ed5e923497f42c3ade5cd9f849f737e/users/8cca91079e684084a2ee22d5130b39a6/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:22.885373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e706f91-c03c-4298-8774-82eb0481497d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.981149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 948/1906] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:22 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:22.983914 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e0a0-22de-4a41-91cd-190b2897f544 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:22.986576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e706f91-c03c-4298-8774-82eb0481497d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:23.068717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9212f4f-f4fa-4c95-96e0-730fd3df68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:23.076423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9212f4f-f4fa-4c95-96e0-730fd3df68d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:23.076423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9212f4f-f4fa-4c95-96e0-730fd3df68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:23.076423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9212f4f-f4fa-4c95-96e0-730fd3df68d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:23.076423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9212f4f-f4fa-4c95-96e0-730fd3df68d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:23.076423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9212f4f-f4fa-4c95-96e0-730fd3df68d7 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:23.080583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e0a0-22de-4a41-91cd-190b2897f544 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:23.089591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749679c6-8593-48d1-b433-faa2b84bf2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:23.090775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749679c6-8593-48d1-b433-faa2b84bf2db admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:23.091352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749679c6-8593-48d1-b433-faa2b84bf2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:23.091823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749679c6-8593-48d1-b433-faa2b84bf2db admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:23.093055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749679c6-8593-48d1-b433-faa2b84bf2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:23.093647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 959/1907] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:23.096468 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749679c6-8593-48d1-b433-faa2b84bf2db admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:23.097772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9212f4f-f4fa-4c95-96e0-730fd3df68d7 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:23.125756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9212f4f-f4fa-4c95-96e0-730fd3df68d7 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:23.130883 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc86b10-d70d-4dfb-90ea-24e28b9c7b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:23.131847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc86b10-d70d-4dfb-90ea-24e28b9c7b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:23.132158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc86b10-d70d-4dfb-90ea-24e28b9c7b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:23.132940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc86b10-d70d-4dfb-90ea-24e28b9c7b7d admin admin] PATH_INFO: `/v3/projects/4ed5e923497f42c3ade5cd9f849f737e/users/8cca91079e684084a2ee22d5130b39a6/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:23.135522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc86b10-d70d-4dfb-90ea-24e28b9c7b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed5e923497f42c3ade5cd9f849f737e, user_id=8cca91079e684084a2ee22d5130b39a6, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:23.138677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc86b10-d70d-4dfb-90ea-24e28b9c7b7d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:23.164120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 960/1908] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:23 2022] PUT /identity/v3/projects/4ed5e923497f42c3ade5cd9f849f737e/users/8cca91079e684084a2ee22d5130b39a6/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:23.282779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 949/1909] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:22 2022] POST /identity/v3/users => generated 294 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:23.287394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc86b10-d70d-4dfb-90ea-24e28b9c7b7d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:23.377259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc86b10-d70d-4dfb-90ea-24e28b9c7b7d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:23.382087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60bed-c8f7-4c00-bc9f-acfa25789813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:23.384423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60bed-c8f7-4c00-bc9f-acfa25789813 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:23.384423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60bed-c8f7-4c00-bc9f-acfa25789813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:23.384423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60bed-c8f7-4c00-bc9f-acfa25789813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:23.385001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a60bed-c8f7-4c00-bc9f-acfa25789813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:23.386784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a60bed-c8f7-4c00-bc9f-acfa25789813 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:23.400810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 961/1910] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:23.405097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749679c6-8593-48d1-b433-faa2b84bf2db admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:23.417548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749679c6-8593-48d1-b433-faa2b84bf2db admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:23.422877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714e1e-951c-4d73-95e9-e389145bdd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:23.423803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714e1e-951c-4d73-95e9-e389145bdd40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:23.424132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714e1e-951c-4d73-95e9-e389145bdd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:23.424401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714e1e-951c-4d73-95e9-e389145bdd40 admin admin] PATH_INFO: `/v3/projects/d7fa8621ffc3402788d523de1a85d68e/users/95c9fc4c832d4d94b2e949bc92c26967/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:23.434348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60bed-c8f7-4c00-bc9f-acfa25789813 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:23.435993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-44a60bed-c8f7-4c00-bc9f-acfa25789813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:23.447413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d714e1e-951c-4d73-95e9-e389145bdd40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fa8621ffc3402788d523de1a85d68e, user_id=95c9fc4c832d4d94b2e949bc92c26967, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:23.450333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d714e1e-951c-4d73-95e9-e389145bdd40 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:23.467262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60bed-c8f7-4c00-bc9f-acfa25789813 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:23.473050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:23.474153 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:23.474291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:23.474559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] PATH_INFO: `/v3/projects/01658b1563e5472a8e4dfb6b3ad2412d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:23.475901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01658b1563e5472a8e4dfb6b3ad2412d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:23.478323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:23.482043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:23.557206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 950/1911] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:23 2022] PUT /identity/v3/projects/d7fa8621ffc3402788d523de1a85d68e/users/95c9fc4c832d4d94b2e949bc92c26967/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:23.561323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714e1e-951c-4d73-95e9-e389145bdd40 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:23.650943 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714e1e-951c-4d73-95e9-e389145bdd40 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:23.672218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01658b1563e5472a8e4dfb6b3ad2412d', 'request_id': 'req-fd6322a5-2408-4a47-928a-1a319afcb9b7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:23.679623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01658b1563e5472a8e4dfb6b3ad2412d', 'request_id': 'req-fd6322a5-2408-4a47-928a-1a319afcb9b7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:23.687904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01658b1563e5472a8e4dfb6b3ad2412d', 'request_id': 'req-fd6322a5-2408-4a47-928a-1a319afcb9b7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:23.776312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] The token cache is being invalidate because project 01658b1563e5472a8e4dfb6b3ad2412d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:23.778829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:23.782339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:23.784432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 962/1912] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:23 2022] DELETE /identity/v3/projects/01658b1563e5472a8e4dfb6b3ad2412d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:23.795014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:23.800849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:23.817927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2243ba-b731-4ddc-a1e6-16c6cad6007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:23.818774 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2243ba-b731-4ddc-a1e6-16c6cad6007d admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:23.819638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2243ba-b731-4ddc-a1e6-16c6cad6007d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:23.820567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2243ba-b731-4ddc-a1e6-16c6cad6007d admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:23.822226 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2243ba-b731-4ddc-a1e6-16c6cad6007d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:23.825435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2243ba-b731-4ddc-a1e6-16c6cad6007d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:23.832315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6322a5-2408-4a47-928a-1a319afcb9b7 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:23.845979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:23.847154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:23.850349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:23.850743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] PATH_INFO: `/v3/users/c9013ab7880140298b4b5352524385b2` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:23.854483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9013ab7880140298b4b5352524385b2)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:23.855118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 951/1913] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:23.856749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:23.858201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2243ba-b731-4ddc-a1e6-16c6cad6007d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:23.868097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fb2243ba-b731-4ddc-a1e6-16c6cad6007d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:23.912300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2243ba-b731-4ddc-a1e6-16c6cad6007d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:23.925464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2668a-05c8-4e5a-b4a0-7814e935886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:23.926731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2668a-05c8-4e5a-b4a0-7814e935886a admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:23.927206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2668a-05c8-4e5a-b4a0-7814e935886a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:23.927644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2668a-05c8-4e5a-b4a0-7814e935886a admin admin] PATH_INFO: `/v3/projects/d7fa8621ffc3402788d523de1a85d68e/users/95c9fc4c832d4d94b2e949bc92c26967/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:23.931339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2668a-05c8-4e5a-b4a0-7814e935886a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fa8621ffc3402788d523de1a85d68e, user_id=95c9fc4c832d4d94b2e949bc92c26967, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:23.935021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2668a-05c8-4e5a-b4a0-7814e935886a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:23.951837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 952/1914] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:23 2022] PUT /identity/v3/projects/d7fa8621ffc3402788d523de1a85d68e/users/95c9fc4c832d4d94b2e949bc92c26967/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:23.963935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93c8c-0ecc-4653-8701-8faaf3f33f4c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:23.963935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93c8c-0ecc-4653-8701-8faaf3f33f4c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:23.964901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93c8c-0ecc-4653-8701-8faaf3f33f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:24.007196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-87e93c8c-0ecc-4653-8701-8faaf3f33f4c None None] MFA Rules not processed for user `95c9fc4c832d4d94b2e949bc92c26967`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:24.009397 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-87e93c8c-0ecc-4653-8701-8faaf3f33f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:24.107919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 953/1915] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:24.122946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93c8c-0ecc-4653-8701-8faaf3f33f4c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:24.124873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-87e93c8c-0ecc-4653-8701-8faaf3f33f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:24.206990 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93c8c-0ecc-4653-8701-8faaf3f33f4c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:24.225032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3275e-2b66-4454-83ad-858299b9dafd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:24.230221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3275e-2b66-4454-83ad-858299b9dafd service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:24.230979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3275e-2b66-4454-83ad-858299b9dafd service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:24.231491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3275e-2b66-4454-83ad-858299b9dafd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:24.234848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1df3275e-2b66-4454-83ad-858299b9dafd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:24.237468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9013ab7880140298b4b5352524385b2'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:24.259906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9013ab7880140298b4b5352524385b2'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:24.327580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9013ab7880140298b4b5352524385b2'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:24.328788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9013ab7880140298b4b5352524385b2'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:24.330125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9013ab7880140298b4b5352524385b2'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:24.341033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3275e-2b66-4454-83ad-858299b9dafd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:24.342644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3275e-2b66-4454-83ad-858299b9dafd service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:24.357014 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 954/1916] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:40:24.408319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 963/1917] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:23 2022] DELETE /identity/v3/users/c9013ab7880140298b4b5352524385b2 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:24.756109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:25.098768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3275e-2b66-4454-83ad-858299b9dafd service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:25.104565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1df3275e-2b66-4454-83ad-858299b9dafd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:25.190805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3275e-2b66-4454-83ad-858299b9dafd service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:25.318917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:25.320642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:25.321268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:25.321773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] PATH_INFO: `/v3/users/632c8e36e07c477b95a3cc669bd92976` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:25.324334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=632c8e36e07c477b95a3cc669bd92976)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:25.328447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:25.602991 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632c8e36e07c477b95a3cc669bd92976'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:25.639169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632c8e36e07c477b95a3cc669bd92976'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:25.640694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:25.645899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:25.658827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0565-b7bb-41b2-8307-8f2ecb614973 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:25.665018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:25.666172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:25.666632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:25.668729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] PATH_INFO: `/v3/projects/070edde96d0a44bc8a89fd18d6214c02` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:25.668729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] RBAC: Authorizing `identity:delete_project(project_id=070edde96d0a44bc8a89fd18d6214c02)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:25.672404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:25.711874 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632c8e36e07c477b95a3cc669bd92976'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:25.715101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632c8e36e07c477b95a3cc669bd92976'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:25.715101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-59ae7e64-b9e5-46b9-ba99-b00965c9f73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632c8e36e07c477b95a3cc669bd92976'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:25.739197 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 955/1918] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:25 2022] DELETE /identity/v3/users/632c8e36e07c477b95a3cc669bd92976 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:25.743490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890be981-4623-4bdf-988b-78ed65e12d67 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:25.743935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890be981-4623-4bdf-988b-78ed65e12d67 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:25.747972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890be981-4623-4bdf-988b-78ed65e12d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:25.771279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-890be981-4623-4bdf-988b-78ed65e12d67 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:25.774434 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-890be981-4623-4bdf-988b-78ed65e12d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:25.838972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 956/1919] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:25.851943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070edde96d0a44bc8a89fd18d6214c02', 'request_id': 'req-6ec34def-934c-4922-a01a-1f0f00a1512b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:25.852729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890be981-4623-4bdf-988b-78ed65e12d67 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:25.854186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-890be981-4623-4bdf-988b-78ed65e12d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:25.858306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070edde96d0a44bc8a89fd18d6214c02', 'request_id': 'req-6ec34def-934c-4922-a01a-1f0f00a1512b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:25.867180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070edde96d0a44bc8a89fd18d6214c02', 'request_id': 'req-6ec34def-934c-4922-a01a-1f0f00a1512b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:25.918952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890be981-4623-4bdf-988b-78ed65e12d67 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:25.955450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] The token cache is being invalidate because project 070edde96d0a44bc8a89fd18d6214c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:25.956110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:25.956944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-6ec34def-934c-4922-a01a-1f0f00a1512b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:25.964730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 964/1920] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:25 2022] DELETE /identity/v3/projects/070edde96d0a44bc8a89fd18d6214c02 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:25.966521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39992110-0d05-41a7-815a-a931f412b64f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:25.966813 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39992110-0d05-41a7-815a-a931f412b64f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:25.967643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39992110-0d05-41a7-815a-a931f412b64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:25.990654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d163e13-15b2-4a63-9fac-90aeb3bc4175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:25.992276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d163e13-15b2-4a63-9fac-90aeb3bc4175 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:25.992276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d163e13-15b2-4a63-9fac-90aeb3bc4175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:25.992555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d163e13-15b2-4a63-9fac-90aeb3bc4175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:25.993719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-39992110-0d05-41a7-815a-a931f412b64f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:25.994417 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3d163e13-15b2-4a63-9fac-90aeb3bc4175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:25.994961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-39992110-0d05-41a7-815a-a931f412b64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:26.091486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d163e13-15b2-4a63-9fac-90aeb3bc4175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:26.094126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d163e13-15b2-4a63-9fac-90aeb3bc4175 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:26.099161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 965/1921] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:26.101471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d31ce-37db-4f6f-96e5-29bfa8ff327f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.102258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d31ce-37db-4f6f-96e5-29bfa8ff327f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.103002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d31ce-37db-4f6f-96e5-29bfa8ff327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.114120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 957/1922] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:40:26.116550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc4bac-0334-4c07-aede-6810a64560c6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.117050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc4bac-0334-4c07-aede-6810a64560c6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.117551 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc4bac-0334-4c07-aede-6810a64560c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.149466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-28bc4bac-0334-4c07-aede-6810a64560c6 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:26.150833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-943d31ce-37db-4f6f-96e5-29bfa8ff327f None None] MFA Rules not processed for user `8cca91079e684084a2ee22d5130b39a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:26.151754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-28bc4bac-0334-4c07-aede-6810a64560c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:26.152831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-943d31ce-37db-4f6f-96e5-29bfa8ff327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:26.166126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 958/1923] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:26.171785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc4bac-0334-4c07-aede-6810a64560c6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:26.192803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc4bac-0334-4c07-aede-6810a64560c6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:26.199042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:26.207269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a33f4-30f7-4157-8c75-ceac6a5575ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:26.209061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a33f4-30f7-4157-8c75-ceac6a5575ef admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.209788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a33f4-30f7-4157-8c75-ceac6a5575ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.211261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a33f4-30f7-4157-8c75-ceac6a5575ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.213096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a33f4-30f7-4157-8c75-ceac6a5575ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:26.213860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a33f4-30f7-4157-8c75-ceac6a5575ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:26.218172 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a33f4-30f7-4157-8c75-ceac6a5575ef admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:26.246728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 959/1924] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:26.251877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a33f4-30f7-4157-8c75-ceac6a5575ef admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:26.270543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a33f4-30f7-4157-8c75-ceac6a5575ef admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:26.278789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde1a7-ddc4-4304-bfb1-8b6115613827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:26.279550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde1a7-ddc4-4304-bfb1-8b6115613827 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.279839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde1a7-ddc4-4304-bfb1-8b6115613827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.280152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde1a7-ddc4-4304-bfb1-8b6115613827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.280923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fde1a7-ddc4-4304-bfb1-8b6115613827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:26.283280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fde1a7-ddc4-4304-bfb1-8b6115613827 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:26.316762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 966/1925] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:26.318756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:26.328280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc93db-7f3a-41ac-b9d9-b30ab7248bd1 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.329032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc93db-7f3a-41ac-b9d9-b30ab7248bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.329381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc93db-7f3a-41ac-b9d9-b30ab7248bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.351572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-24bc93db-7f3a-41ac-b9d9-b30ab7248bd1 None None] MFA Rules not processed for user `b51cc916e4264bbdb09eb20f804ee876`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:26.351967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-24bc93db-7f3a-41ac-b9d9-b30ab7248bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:26.413392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 960/1926] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:26 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:26.418786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde1a7-ddc4-4304-bfb1-8b6115613827 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:26.422504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 967/1927] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:26.487550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde1a7-ddc4-4304-bfb1-8b6115613827 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:26.493743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfca5-f1a7-44fb-8ecb-d1de34ce2eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:26.494328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfca5-f1a7-44fb-8ecb-d1de34ce2eba admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.494608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfca5-f1a7-44fb-8ecb-d1de34ce2eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.494946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfca5-f1a7-44fb-8ecb-d1de34ce2eba admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.495718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acfca5-f1a7-44fb-8ecb-d1de34ce2eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:26.497822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acfca5-f1a7-44fb-8ecb-d1de34ce2eba admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:26.597235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 961/1928] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:26 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:26.600956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc93db-7f3a-41ac-b9d9-b30ab7248bd1 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:26.619851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfca5-f1a7-44fb-8ecb-d1de34ce2eba admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:26.621295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc93db-7f3a-41ac-b9d9-b30ab7248bd1 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:26.622144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-27acfca5-f1a7-44fb-8ecb-d1de34ce2eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:26.628659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c4a2a-c724-41dc-a5f2-e961ae1cb179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:26.630621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c4a2a-c724-41dc-a5f2-e961ae1cb179 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.634259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c4a2a-c724-41dc-a5f2-e961ae1cb179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.634259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c4a2a-c724-41dc-a5f2-e961ae1cb179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.634259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c4a2a-c724-41dc-a5f2-e961ae1cb179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:26.635588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c4a2a-c724-41dc-a5f2-e961ae1cb179 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:26.662010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 968/1929] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:26.665726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c4a2a-c724-41dc-a5f2-e961ae1cb179 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:26.676687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c4a2a-c724-41dc-a5f2-e961ae1cb179 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:26.682514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf306f-849a-48df-b97b-23cf4c90ba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:26.683281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf306f-849a-48df-b97b-23cf4c90ba02 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.683569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf306f-849a-48df-b97b-23cf4c90ba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.683849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf306f-849a-48df-b97b-23cf4c90ba02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.684684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf306f-849a-48df-b97b-23cf4c90ba02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:26.689362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf306f-849a-48df-b97b-23cf4c90ba02 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:26.708474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 969/1930] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:26.710503 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf306f-849a-48df-b97b-23cf4c90ba02 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:26.715550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfca5-f1a7-44fb-8ecb-d1de34ce2eba admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:26.721723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf306f-849a-48df-b97b-23cf4c90ba02 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:26.722507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48299d71-06c5-4130-adca-799ed8fdfe61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:26.723326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48299d71-06c5-4130-adca-799ed8fdfe61 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.723589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48299d71-06c5-4130-adca-799ed8fdfe61 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.723867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48299d71-06c5-4130-adca-799ed8fdfe61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.725890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-48299d71-06c5-4130-adca-799ed8fdfe61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:26.727216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c44b80-97c9-4628-9ea8-7ef68a630238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:26.728198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44b80-97c9-4628-9ea8-7ef68a630238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.728562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44b80-97c9-4628-9ea8-7ef68a630238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.728840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44b80-97c9-4628-9ea8-7ef68a630238 admin admin] PATH_INFO: `/v3/projects/1709f784310743b5bf9e7f8293775162/users/b054bc0ac8c347cbb5b9db76d7758531/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.747200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c44b80-97c9-4628-9ea8-7ef68a630238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1709f784310743b5bf9e7f8293775162, user_id=b054bc0ac8c347cbb5b9db76d7758531, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:26.760695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c44b80-97c9-4628-9ea8-7ef68a630238 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:26.795313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48299d71-06c5-4130-adca-799ed8fdfe61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:26.796956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48299d71-06c5-4130-adca-799ed8fdfe61 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:26.807926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 962/1931] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:40:26.836676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48299d71-06c5-4130-adca-799ed8fdfe61 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:26.838094 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-48299d71-06c5-4130-adca-799ed8fdfe61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:26.856404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48299d71-06c5-4130-adca-799ed8fdfe61 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:26.860767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 970/1932] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:26 2022] PUT /identity/v3/projects/1709f784310743b5bf9e7f8293775162/users/b054bc0ac8c347cbb5b9db76d7758531/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:26.871909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8a46-a5a4-468e-a83e-1767b3817398 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.872238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8a46-a5a4-468e-a83e-1767b3817398 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.872515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8a46-a5a4-468e-a83e-1767b3817398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.911984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-7a8e8a46-a5a4-468e-a83e-1767b3817398 None None] MFA Rules not processed for user `b054bc0ac8c347cbb5b9db76d7758531`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:26.913251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7a8e8a46-a5a4-468e-a83e-1767b3817398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:26.961773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:26.966491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:26.966491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:26.966491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] PATH_INFO: `/v3/projects/9c45cc57cc244464abd7a1a3b0308102` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:26.966491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c45cc57cc244464abd7a1a3b0308102)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:26.966952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:27.050444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 971/1933] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:27.051487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e8a46-a5a4-468e-a83e-1767b3817398 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:27.064295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e8a46-a5a4-468e-a83e-1767b3817398 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:27.070273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76727189-3319-4b88-a6fe-eb2fc91140ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:27.070928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76727189-3319-4b88-a6fe-eb2fc91140ab admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:27.071515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76727189-3319-4b88-a6fe-eb2fc91140ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:27.071515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76727189-3319-4b88-a6fe-eb2fc91140ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:27.072248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76727189-3319-4b88-a6fe-eb2fc91140ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:27.074922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76727189-3319-4b88-a6fe-eb2fc91140ab admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:27.215027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 972/1934] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:27 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:27.216467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76727189-3319-4b88-a6fe-eb2fc91140ab admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:27.228734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c45cc57cc244464abd7a1a3b0308102', 'request_id': 'req-c0f8c948-db51-4250-b7df-9d9c6c2e2083'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:27.235223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c45cc57cc244464abd7a1a3b0308102', 'request_id': 'req-c0f8c948-db51-4250-b7df-9d9c6c2e2083'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:27.301545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76727189-3319-4b88-a6fe-eb2fc91140ab admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:27.307663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee708da5-6e86-4ee6-a028-4b9494ee215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:27.308474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708da5-6e86-4ee6-a028-4b9494ee215f admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:27.308760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708da5-6e86-4ee6-a028-4b9494ee215f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:27.309037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708da5-6e86-4ee6-a028-4b9494ee215f admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:27.309733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee708da5-6e86-4ee6-a028-4b9494ee215f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:27.311670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee708da5-6e86-4ee6-a028-4b9494ee215f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:27.406667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c45cc57cc244464abd7a1a3b0308102', 'request_id': 'req-c0f8c948-db51-4250-b7df-9d9c6c2e2083'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:27.425166 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] The token cache is being invalidate because project 9c45cc57cc244464abd7a1a3b0308102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:27.425458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:27.426127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:27.427722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 963/1935] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:26 2022] DELETE /identity/v3/projects/9c45cc57cc244464abd7a1a3b0308102 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:27.432012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:27.433509 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:27.445824 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 973/1936] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:27 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:27.449346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee708da5-6e86-4ee6-a028-4b9494ee215f admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:27.452661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ee708da5-6e86-4ee6-a028-4b9494ee215f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:27.466166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee708da5-6e86-4ee6-a028-4b9494ee215f admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:27.471602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4a984-eb3f-42f2-9df8-299cc92a0cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:27.472528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4a984-eb3f-42f2-9df8-299cc92a0cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:27.472609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4a984-eb3f-42f2-9df8-299cc92a0cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:27.472869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4a984-eb3f-42f2-9df8-299cc92a0cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:27.473780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4a984-eb3f-42f2-9df8-299cc92a0cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:27.475361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4a984-eb3f-42f2-9df8-299cc92a0cc8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:27.487043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 974/1937] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:27.491190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4a984-eb3f-42f2-9df8-299cc92a0cc8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:27.502432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4a984-eb3f-42f2-9df8-299cc92a0cc8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:27.509112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d2924-eb3f-4edc-8c92-6e0d96792e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:27.510186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2924-eb3f-4edc-8c92-6e0d96792e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:27.510761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2924-eb3f-4edc-8c92-6e0d96792e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:27.511145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2924-eb3f-4edc-8c92-6e0d96792e39 admin admin] PATH_INFO: `/v3/projects/f2169794686641d0b534229cb04499d7/users/ee3db0bc24ff4783a45246134e77ffd8/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:27.522048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8c948-db51-4250-b7df-9d9c6c2e2083 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:27.528190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d2924-eb3f-4edc-8c92-6e0d96792e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2169794686641d0b534229cb04499d7, user_id=ee3db0bc24ff4783a45246134e77ffd8, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:27.528857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:27.529841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:27.530199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:27.530554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] PATH_INFO: `/v3/users/3a2c0c7aed7740de9c20a1f8c573bc54` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:27.531541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d2924-eb3f-4edc-8c92-6e0d96792e39 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:27.532239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2c0c7aed7740de9c20a1f8c573bc54)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:27.534389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:27.751242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:27.759954 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 975/1938] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:27 2022] PUT /identity/v3/projects/f2169794686641d0b534229cb04499d7/users/ee3db0bc24ff4783a45246134e77ffd8/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:27.772521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d2924-eb3f-4edc-8c92-6e0d96792e39 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:27.863204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2c0c7aed7740de9c20a1f8c573bc54'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:27.881288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2c0c7aed7740de9c20a1f8c573bc54'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:27.896903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d2924-eb3f-4edc-8c92-6e0d96792e39 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:27.902592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df919d6-fa24-443b-ba50-c40ce596f8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:27.903849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df919d6-fa24-443b-ba50-c40ce596f8eb admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:27.904887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df919d6-fa24-443b-ba50-c40ce596f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:27.905178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df919d6-fa24-443b-ba50-c40ce596f8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:27.905987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df919d6-fa24-443b-ba50-c40ce596f8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:27.907644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df919d6-fa24-443b-ba50-c40ce596f8eb admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:27.922824 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 976/1939] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:27.928119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df919d6-fa24-443b-ba50-c40ce596f8eb admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:27.941493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df919d6-fa24-443b-ba50-c40ce596f8eb admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:27.975545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8364ce-6624-4996-8188-b6005aa8d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:27.977859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8364ce-6624-4996-8188-b6005aa8d38a admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:27.978474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8364ce-6624-4996-8188-b6005aa8d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:27.978701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8364ce-6624-4996-8188-b6005aa8d38a admin admin] PATH_INFO: `/v3/projects/f2169794686641d0b534229cb04499d7/users/ee3db0bc24ff4783a45246134e77ffd8/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:27.980108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2c0c7aed7740de9c20a1f8c573bc54'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:27.981104 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2c0c7aed7740de9c20a1f8c573bc54'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:27.982179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-39326930-3ed7-433b-a5cc-b2de1fe4c618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2c0c7aed7740de9c20a1f8c573bc54'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:27.983878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8364ce-6624-4996-8188-b6005aa8d38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2169794686641d0b534229cb04499d7, user_id=ee3db0bc24ff4783a45246134e77ffd8, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:27.986865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8364ce-6624-4996-8188-b6005aa8d38a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:28.014995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 964/1940] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:27 2022] DELETE /identity/v3/users/3a2c0c7aed7740de9c20a1f8c573bc54 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:28.032058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 977/1941] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:27 2022] PUT /identity/v3/projects/f2169794686641d0b534229cb04499d7/users/ee3db0bc24ff4783a45246134e77ffd8/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:28.044559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15b861-7f36-4751-8fae-64683354515e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:28.044913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15b861-7f36-4751-8fae-64683354515e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:28.045207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15b861-7f36-4751-8fae-64683354515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:28.088343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7f15b861-7f36-4751-8fae-64683354515e None None] MFA Rules not processed for user `ee3db0bc24ff4783a45246134e77ffd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:28.089618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7f15b861-7f36-4751-8fae-64683354515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:28.201880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 965/1942] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:28.214913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8364ce-6624-4996-8188-b6005aa8d38a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:28.216998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-bd8364ce-6624-4996-8188-b6005aa8d38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:28.282609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8364ce-6624-4996-8188-b6005aa8d38a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:28.349012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e8940-f3ae-4f73-89f8-a4f995fd431e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:28.349835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8940-f3ae-4f73-89f8-a4f995fd431e service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:28.350216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8940-f3ae-4f73-89f8-a4f995fd431e service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:28.350718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8940-f3ae-4f73-89f8-a4f995fd431e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:28.362268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e8940-f3ae-4f73-89f8-a4f995fd431e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:28.364124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e8940-f3ae-4f73-89f8-a4f995fd431e service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:28.376528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 978/1943] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:28.455010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15b861-7f36-4751-8fae-64683354515e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:28.456621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7f15b861-7f36-4751-8fae-64683354515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:28.525402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15b861-7f36-4751-8fae-64683354515e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:28.529908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:28.530789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:28.531068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:28.531341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] PATH_INFO: `/v3/users/b054bc0ac8c347cbb5b9db76d7758531` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:28.532622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b054bc0ac8c347cbb5b9db76d7758531)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:28.534530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:28.634662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e8940-f3ae-4f73-89f8-a4f995fd431e service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:28.634662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9a6e8940-f3ae-4f73-89f8-a4f995fd431e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:28.647419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e8940-f3ae-4f73-89f8-a4f995fd431e service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:28.653450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:28.654618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:28.654764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:28.654975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] PATH_INFO: `/v3/projects/0c52393de1bb40889a60545e5bfba8dc` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:28.656243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c52393de1bb40889a60545e5bfba8dc)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:28.658180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:28.761426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:28.829429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b054bc0ac8c347cbb5b9db76d7758531'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:28.842271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c52393de1bb40889a60545e5bfba8dc', 'request_id': 'req-8f8f041a-0917-4c20-b999-c3ccb81d233a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:28.847940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c52393de1bb40889a60545e5bfba8dc', 'request_id': 'req-8f8f041a-0917-4c20-b999-c3ccb81d233a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:28.856290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c52393de1bb40889a60545e5bfba8dc', 'request_id': 'req-8f8f041a-0917-4c20-b999-c3ccb81d233a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:28.865196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b054bc0ac8c347cbb5b9db76d7758531'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:28.971268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] The token cache is being invalidate because project 0c52393de1bb40889a60545e5bfba8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:28.971564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:28.972277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:28.973876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 979/1944] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:28 2022] DELETE /identity/v3/projects/0c52393de1bb40889a60545e5bfba8dc => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:28.984299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:28.986115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:29.053943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f041a-0917-4c20-b999-c3ccb81d233a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:29.059530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:29.060485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:29.060768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:29.061047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] PATH_INFO: `/v3/users/20948c3b401c406caa4cdcea7847fa5e` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:29.062255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=20948c3b401c406caa4cdcea7847fa5e)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:29.064217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:29.140052 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b054bc0ac8c347cbb5b9db76d7758531'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:29.141411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b054bc0ac8c347cbb5b9db76d7758531'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:29.142245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-693e9ed0-a6a0-4cfa-a51f-613f97ad8196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b054bc0ac8c347cbb5b9db76d7758531'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:29.171701 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 966/1945] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:28 2022] DELETE /identity/v3/users/b054bc0ac8c347cbb5b9db76d7758531 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:29.177846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30582166-1810-4e0a-a9b0-86386025372b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:29.178179 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30582166-1810-4e0a-a9b0-86386025372b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:29.178401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30582166-1810-4e0a-a9b0-86386025372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:29.199440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-30582166-1810-4e0a-a9b0-86386025372b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:29.200780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-30582166-1810-4e0a-a9b0-86386025372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:29.296242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 967/1946] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:29.297154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30582166-1810-4e0a-a9b0-86386025372b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:29.298810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-30582166-1810-4e0a-a9b0-86386025372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:29.350630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20948c3b401c406caa4cdcea7847fa5e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:29.368009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20948c3b401c406caa4cdcea7847fa5e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:29.375711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30582166-1810-4e0a-a9b0-86386025372b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:29.387605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a0b2-927a-4e92-a441-f31cdb045e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:29.388321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a0b2-927a-4e92-a441-f31cdb045e2a service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:29.388605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a0b2-927a-4e92-a441-f31cdb045e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:29.388884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a0b2-927a-4e92-a441-f31cdb045e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:29.391722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-88f2a0b2-927a-4e92-a441-f31cdb045e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:29.481901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2a0b2-927a-4e92-a441-f31cdb045e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:29.483408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2a0b2-927a-4e92-a441-f31cdb045e2a service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:29.495843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 968/1947] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:29.497421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a0b2-927a-4e92-a441-f31cdb045e2a service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:29.502376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-88f2a0b2-927a-4e92-a441-f31cdb045e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:29.503962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20948c3b401c406caa4cdcea7847fa5e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:29.505211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20948c3b401c406caa4cdcea7847fa5e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:29.506014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20948c3b401c406caa4cdcea7847fa5e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:29.525480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 980/1948] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:28 2022] DELETE /identity/v3/users/20948c3b401c406caa4cdcea7847fa5e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:29.696731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a0b2-927a-4e92-a441-f31cdb045e2a service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:29.860477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a37931-e717-4941-894f-18210b28e97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:29.862220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a37931-e717-4941-894f-18210b28e97a service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:29.862789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a37931-e717-4941-894f-18210b28e97a service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:29.863592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a37931-e717-4941-894f-18210b28e97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:29.869043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d4a37931-e717-4941-894f-18210b28e97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:30.011971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a37931-e717-4941-894f-18210b28e97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:30.015577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a37931-e717-4941-894f-18210b28e97a service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:30.031438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 969/1949] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:30.312115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:30.644028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:30.648003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:30.674249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c680e03-b1ae-4b6a-8490-87bac07637ee admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:30.683509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:30.685284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:30.685773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:30.686322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] PATH_INFO: `/v3/projects/18c4cb3ecc8f474a8ce5089175738a61` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:30.689757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c4cb3ecc8f474a8ce5089175738a61)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:30.692851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:30.861249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c4cb3ecc8f474a8ce5089175738a61', 'request_id': 'req-b1115593-926f-45ea-b825-8d223ea69e91'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:30.867974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c4cb3ecc8f474a8ce5089175738a61', 'request_id': 'req-b1115593-926f-45ea-b825-8d223ea69e91'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:30.875121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c4cb3ecc8f474a8ce5089175738a61', 'request_id': 'req-b1115593-926f-45ea-b825-8d223ea69e91'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.032831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] The token cache is being invalidate because project 18c4cb3ecc8f474a8ce5089175738a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:31.033838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.035686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b1115593-926f-45ea-b825-8d223ea69e91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.040786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 981/1950] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:30 2022] DELETE /identity/v3/projects/18c4cb3ecc8f474a8ce5089175738a61 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:31.050156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b901e-5115-43c4-b627-8e402fd87afc None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.051830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b901e-5115-43c4-b627-8e402fd87afc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.052554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b901e-5115-43c4-b627-8e402fd87afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.087922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-561b901e-5115-43c4-b627-8e402fd87afc None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:31.089417 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-561b901e-5115-43c4-b627-8e402fd87afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:31.191298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 970/1951] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:31.193155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e4c0e-1dff-4795-b892-8a4121049846 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.196124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e4c0e-1dff-4795-b892-8a4121049846 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.196769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e4c0e-1dff-4795-b892-8a4121049846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.240887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-5e3e4c0e-1dff-4795-b892-8a4121049846 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:31.252830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5e3e4c0e-1dff-4795-b892-8a4121049846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:31.267230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:31.282074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b901e-5115-43c4-b627-8e402fd87afc None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:31.288194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 982/1952] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:31.290517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-561b901e-5115-43c4-b627-8e402fd87afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:31.310876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e4c0e-1dff-4795-b892-8a4121049846 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:31.318872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b901e-5115-43c4-b627-8e402fd87afc None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:31.326605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:31.327479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.327761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.328043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] PATH_INFO: `/v3/projects/1709f784310743b5bf9e7f8293775162` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.329411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1709f784310743b5bf9e7f8293775162)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:31.331520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:31.338060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e4c0e-1dff-4795-b892-8a4121049846 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:31.349881 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0fbb-b1a7-4647-85c5-a81cbb970cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:31.351650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0fbb-b1a7-4647-85c5-a81cbb970cae admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.352415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0fbb-b1a7-4647-85c5-a81cbb970cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.353088 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0fbb-b1a7-4647-85c5-a81cbb970cae admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.354477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0fbb-b1a7-4647-85c5-a81cbb970cae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:31.355096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0fbb-b1a7-4647-85c5-a81cbb970cae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:31.358008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0fbb-b1a7-4647-85c5-a81cbb970cae admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:31.378443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 983/1953] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:31.383897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0fbb-b1a7-4647-85c5-a81cbb970cae admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:31.394515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0fbb-b1a7-4647-85c5-a81cbb970cae admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:31.403709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccfad6-cd6e-490b-a051-f441dc1b6ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:31.404601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccfad6-cd6e-490b-a051-f441dc1b6ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.405012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccfad6-cd6e-490b-a051-f441dc1b6ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.405390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccfad6-cd6e-490b-a051-f441dc1b6ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.406371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccfad6-cd6e-490b-a051-f441dc1b6ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:31.408564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccfad6-cd6e-490b-a051-f441dc1b6ee4 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:31.467345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1709f784310743b5bf9e7f8293775162', 'request_id': 'req-84ee712a-1096-4230-bfbf-0e75d215e901'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.478103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1709f784310743b5bf9e7f8293775162', 'request_id': 'req-84ee712a-1096-4230-bfbf-0e75d215e901'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.569674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 984/1954] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:31 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:31.571510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccfad6-cd6e-490b-a051-f441dc1b6ee4 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:31.577175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1709f784310743b5bf9e7f8293775162', 'request_id': 'req-84ee712a-1096-4230-bfbf-0e75d215e901'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.592526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] The token cache is being invalidate because project 1709f784310743b5bf9e7f8293775162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:31.592819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.593551 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:31.608845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 971/1955] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:31 2022] DELETE /identity/v3/projects/1709f784310743b5bf9e7f8293775162 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:31.613284 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:31.617299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:31.686368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccfad6-cd6e-490b-a051-f441dc1b6ee4 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:31.691695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52305d79-6883-4542-8a67-505a1b6d3868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:31.692535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305d79-6883-4542-8a67-505a1b6d3868 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.693191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305d79-6883-4542-8a67-505a1b6d3868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.693665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305d79-6883-4542-8a67-505a1b6d3868 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.694699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52305d79-6883-4542-8a67-505a1b6d3868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:31.697066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52305d79-6883-4542-8a67-505a1b6d3868 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:31.735985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee712a-1096-4230-bfbf-0e75d215e901 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:31.741497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:31.743279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.743671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.744054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] PATH_INFO: `/v3/users/ee3db0bc24ff4783a45246134e77ffd8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.745867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3db0bc24ff4783a45246134e77ffd8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:31.747897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:31.794550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 985/1956] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:31 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:31.798707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52305d79-6883-4542-8a67-505a1b6d3868 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:31.801248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-52305d79-6883-4542-8a67-505a1b6d3868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:31.822715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52305d79-6883-4542-8a67-505a1b6d3868 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:31.822715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd313d-8fa9-45dc-b879-c4836242f683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:31.823393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd313d-8fa9-45dc-b879-c4836242f683 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.823688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd313d-8fa9-45dc-b879-c4836242f683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.823967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd313d-8fa9-45dc-b879-c4836242f683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.824738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd313d-8fa9-45dc-b879-c4836242f683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:31.826326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd313d-8fa9-45dc-b879-c4836242f683 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:31.838050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 986/1957] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:31.843943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd313d-8fa9-45dc-b879-c4836242f683 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:31.867805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd313d-8fa9-45dc-b879-c4836242f683 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:31.876758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c38c07-0bf5-4bf0-92a0-30a80d46203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:31.878150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c38c07-0bf5-4bf0-92a0-30a80d46203c admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.878853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c38c07-0bf5-4bf0-92a0-30a80d46203c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.879653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c38c07-0bf5-4bf0-92a0-30a80d46203c admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.880932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c38c07-0bf5-4bf0-92a0-30a80d46203c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:31.883135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c38c07-0bf5-4bf0-92a0-30a80d46203c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:31.897283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 987/1958] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:31.903391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c38c07-0bf5-4bf0-92a0-30a80d46203c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:31.926394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c38c07-0bf5-4bf0-92a0-30a80d46203c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:31.940832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d559932-4e0e-4cfb-ad8c-3fa1c063f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:31.943069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d559932-4e0e-4cfb-ad8c-3fa1c063f045 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:31.943453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d559932-4e0e-4cfb-ad8c-3fa1c063f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:31.944548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d559932-4e0e-4cfb-ad8c-3fa1c063f045 admin admin] PATH_INFO: `/v3/projects/a4a798ee5eff4c6ba5764ed0c99bbc22/users/06ac2b7c50fb42f6a6dd261b76c71dc5/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:31.979742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d559932-4e0e-4cfb-ad8c-3fa1c063f045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a798ee5eff4c6ba5764ed0c99bbc22, user_id=06ac2b7c50fb42f6a6dd261b76c71dc5, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:31.983909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d559932-4e0e-4cfb-ad8c-3fa1c063f045 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:32.103434 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3db0bc24ff4783a45246134e77ffd8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.117082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3db0bc24ff4783a45246134e77ffd8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.127027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 988/1959] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:31 2022] PUT /identity/v3/projects/a4a798ee5eff4c6ba5764ed0c99bbc22/users/06ac2b7c50fb42f6a6dd261b76c71dc5/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:32.143960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9327e38-61a7-454c-8980-d32e72fb10c4 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:32.144377 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9327e38-61a7-454c-8980-d32e72fb10c4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:32.144662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9327e38-61a7-454c-8980-d32e72fb10c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:32.178523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-b9327e38-61a7-454c-8980-d32e72fb10c4 None None] MFA Rules not processed for user `06ac2b7c50fb42f6a6dd261b76c71dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:32.180553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b9327e38-61a7-454c-8980-d32e72fb10c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:32.297035 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 989/1960] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:32.297409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3db0bc24ff4783a45246134e77ffd8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.301910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3db0bc24ff4783a45246134e77ffd8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.301910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3db0bc24ff4783a45246134e77ffd8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:32.306565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9327e38-61a7-454c-8980-d32e72fb10c4 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:32.339140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 972/1961] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:31 2022] DELETE /identity/v3/users/ee3db0bc24ff4783a45246134e77ffd8 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:32.438783 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9327e38-61a7-454c-8980-d32e72fb10c4 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:32.553907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448a52e-0d40-48bb-9c8e-787a4c8bb162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:32.556047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448a52e-0d40-48bb-9c8e-787a4c8bb162 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:32.556680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448a52e-0d40-48bb-9c8e-787a4c8bb162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:32.557270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448a52e-0d40-48bb-9c8e-787a4c8bb162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:32.560511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448a52e-0d40-48bb-9c8e-787a4c8bb162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:32.563421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448a52e-0d40-48bb-9c8e-787a4c8bb162 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:32.729411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 990/1962] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:32 2022] POST /identity/v3/projects => generated 365 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:32.736923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:32.738945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:32.788101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43fe0-cd2f-4408-9df7-dae640b8134f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:32.877732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7b3d0-f782-43d7-8a10-9c3a0dc92584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:32.878329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7b3d0-f782-43d7-8a10-9c3a0dc92584 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:32.878612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7b3d0-f782-43d7-8a10-9c3a0dc92584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:32.878887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7b3d0-f782-43d7-8a10-9c3a0dc92584 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:32.879626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7b3d0-f782-43d7-8a10-9c3a0dc92584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:32.882002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7b3d0-f782-43d7-8a10-9c3a0dc92584 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:32.948769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448a52e-0d40-48bb-9c8e-787a4c8bb162 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:32.951327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e448a52e-0d40-48bb-9c8e-787a4c8bb162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:32.967950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448a52e-0d40-48bb-9c8e-787a4c8bb162 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:32.973639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:32.974431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:32.976662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:32.976662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] PATH_INFO: `/v3/projects/f2169794686641d0b534229cb04499d7` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:32.977327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2169794686641d0b534229cb04499d7)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:32.979370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.019499 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 973/1963] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:32 2022] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:33.023728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7b3d0-f782-43d7-8a10-9c3a0dc92584 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.034857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7b3d0-f782-43d7-8a10-9c3a0dc92584 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.039141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:33.045855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941312c-4b4f-48d3-b74e-d3cbbaa56937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.045855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941312c-4b4f-48d3-b74e-d3cbbaa56937 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.045855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941312c-4b4f-48d3-b74e-d3cbbaa56937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.045855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941312c-4b4f-48d3-b74e-d3cbbaa56937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.046437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941312c-4b4f-48d3-b74e-d3cbbaa56937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.048105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941312c-4b4f-48d3-b74e-d3cbbaa56937 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.060224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 974/1964] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:33.064648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941312c-4b4f-48d3-b74e-d3cbbaa56937 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.076271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941312c-4b4f-48d3-b74e-d3cbbaa56937 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.081676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5ee71-e411-47a0-8dbb-00724fd5e168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.082886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5ee71-e411-47a0-8dbb-00724fd5e168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.083587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5ee71-e411-47a0-8dbb-00724fd5e168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.084473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5ee71-e411-47a0-8dbb-00724fd5e168 admin admin] PATH_INFO: `/v3/projects/9b21cdb85c2a421d9a0c81b20d3010a2/users/8e9a30b4f3eb47cb9408580be07f258e/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.105074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5ee71-e411-47a0-8dbb-00724fd5e168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b21cdb85c2a421d9a0c81b20d3010a2, user_id=8e9a30b4f3eb47cb9408580be07f258e, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.109815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5ee71-e411-47a0-8dbb-00724fd5e168 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.139865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2169794686641d0b534229cb04499d7', 'request_id': 'req-05215318-a672-4126-bd09-6c83e21935ce'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:33.145952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2169794686641d0b534229cb04499d7', 'request_id': 'req-05215318-a672-4126-bd09-6c83e21935ce'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:33.153751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2169794686641d0b534229cb04499d7', 'request_id': 'req-05215318-a672-4126-bd09-6c83e21935ce'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:33.214641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 975/1965] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:33 2022] PUT /identity/v3/projects/9b21cdb85c2a421d9a0c81b20d3010a2/users/8e9a30b4f3eb47cb9408580be07f258e/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:33.219296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5ee71-e411-47a0-8dbb-00724fd5e168 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.237371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] The token cache is being invalidate because project f2169794686641d0b534229cb04499d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:33.237764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:33.238752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-05215318-a672-4126-bd09-6c83e21935ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:33.245258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 991/1966] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:32 2022] DELETE /identity/v3/projects/f2169794686641d0b534229cb04499d7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:33.248057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3310c-1fb9-4ca6-82ca-9276532b35e1 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.248603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3310c-1fb9-4ca6-82ca-9276532b35e1 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.248983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3310c-1fb9-4ca6-82ca-9276532b35e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.287979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-bef3310c-1fb9-4ca6-82ca-9276532b35e1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:33.290141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-bef3310c-1fb9-4ca6-82ca-9276532b35e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:33.384373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5ee71-e411-47a0-8dbb-00724fd5e168 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.390993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d9931-f112-43e1-8f88-6241aedec845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.391759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9931-f112-43e1-8f88-6241aedec845 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.392215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9931-f112-43e1-8f88-6241aedec845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.392686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9931-f112-43e1-8f88-6241aedec845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.394966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d9931-f112-43e1-8f88-6241aedec845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.396524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d9931-f112-43e1-8f88-6241aedec845 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.413903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 976/1967] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:33.419064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d9931-f112-43e1-8f88-6241aedec845 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.426280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c74d9931-f112-43e1-8f88-6241aedec845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:33.468354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d9931-f112-43e1-8f88-6241aedec845 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.471995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 992/1968] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:33.483013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140af9a6-1317-4b88-a4bd-d70e3a82aa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.483903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419818c-6e28-4ac0-849d-c7f086e20b40 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.484296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419818c-6e28-4ac0-849d-c7f086e20b40 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.484548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419818c-6e28-4ac0-849d-c7f086e20b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.489588 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af9a6-1317-4b88-a4bd-d70e3a82aa69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.491490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af9a6-1317-4b88-a4bd-d70e3a82aa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.492571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af9a6-1317-4b88-a4bd-d70e3a82aa69 admin admin] PATH_INFO: `/v3/projects/9b21cdb85c2a421d9a0c81b20d3010a2/users/8e9a30b4f3eb47cb9408580be07f258e/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.495893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140af9a6-1317-4b88-a4bd-d70e3a82aa69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b21cdb85c2a421d9a0c81b20d3010a2, user_id=8e9a30b4f3eb47cb9408580be07f258e, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.504553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140af9a6-1317-4b88-a4bd-d70e3a82aa69 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.521973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-7419818c-6e28-4ac0-849d-c7f086e20b40 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:33.532528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7419818c-6e28-4ac0-849d-c7f086e20b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:33.542825 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:33.564108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 977/1969] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:33 2022] PUT /identity/v3/projects/9b21cdb85c2a421d9a0c81b20d3010a2/users/8e9a30b4f3eb47cb9408580be07f258e/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:33.579619 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b58b-7a5d-4068-b997-0c3e0cedeacf None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.579877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b58b-7a5d-4068-b997-0c3e0cedeacf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.580768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b58b-7a5d-4068-b997-0c3e0cedeacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.678128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bd95b58b-7a5d-4068-b997-0c3e0cedeacf None None] MFA Rules not processed for user `8e9a30b4f3eb47cb9408580be07f258e`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:33.682300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bd95b58b-7a5d-4068-b997-0c3e0cedeacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:33.696804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 993/1970] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:33.702532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419818c-6e28-4ac0-849d-c7f086e20b40 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.721888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419818c-6e28-4ac0-849d-c7f086e20b40 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.732320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ef0fd-e99a-4e60-b5ea-3e6a51f6cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.736514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ef0fd-e99a-4e60-b5ea-3e6a51f6cc06 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.736514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ef0fd-e99a-4e60-b5ea-3e6a51f6cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.736514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ef0fd-e99a-4e60-b5ea-3e6a51f6cc06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.736514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ef0fd-e99a-4e60-b5ea-3e6a51f6cc06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:33.736514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ef0fd-e99a-4e60-b5ea-3e6a51f6cc06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.739197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ef0fd-e99a-4e60-b5ea-3e6a51f6cc06 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.775402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 994/1971] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:33.777237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ef0fd-e99a-4e60-b5ea-3e6a51f6cc06 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.801009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ef0fd-e99a-4e60-b5ea-3e6a51f6cc06 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:33.811503 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2130dc-23fc-4529-b3bd-4e01dc04560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:33.812229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2130dc-23fc-4529-b3bd-4e01dc04560d admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:33.812518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2130dc-23fc-4529-b3bd-4e01dc04560d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:33.812797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2130dc-23fc-4529-b3bd-4e01dc04560d admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:33.813617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2130dc-23fc-4529-b3bd-4e01dc04560d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:33.815539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2130dc-23fc-4529-b3bd-4e01dc04560d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:33.907513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 978/1972] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:33.922103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b58b-7a5d-4068-b997-0c3e0cedeacf None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:33.926426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bd95b58b-7a5d-4068-b997-0c3e0cedeacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:33.956139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 995/1973] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:33 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:33.963797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2130dc-23fc-4529-b3bd-4e01dc04560d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.124313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2130dc-23fc-4529-b3bd-4e01dc04560d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.137116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b58b-7a5d-4068-b997-0c3e0cedeacf None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.144772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd50b0-2713-4855-bd41-7fcbc7d25e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.145461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd50b0-2713-4855-bd41-7fcbc7d25e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.145919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd50b0-2713-4855-bd41-7fcbc7d25e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.148109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd50b0-2713-4855-bd41-7fcbc7d25e18 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.148109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd50b0-2713-4855-bd41-7fcbc7d25e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.149215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd50b0-2713-4855-bd41-7fcbc7d25e18 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.215530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b475f05-e1a0-49ea-848d-c6b0c3547ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.216582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b475f05-e1a0-49ea-848d-c6b0c3547ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.217098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b475f05-e1a0-49ea-848d-c6b0c3547ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.217490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b475f05-e1a0-49ea-848d-c6b0c3547ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.295826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 996/1974] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:33 2022] POST /identity/v3/users => generated 292 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:34.300401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd50b0-2713-4855-bd41-7fcbc7d25e18 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.322847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd50b0-2713-4855-bd41-7fcbc7d25e18 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.356699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b475f05-e1a0-49ea-848d-c6b0c3547ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.358354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b475f05-e1a0-49ea-848d-c6b0c3547ef5 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.360875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1e21-e07b-4428-ba35-9d436b129529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.362137 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1e21-e07b-4428-ba35-9d436b129529 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.362604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1e21-e07b-4428-ba35-9d436b129529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.363284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1e21-e07b-4428-ba35-9d436b129529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.364775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de1e21-e07b-4428-ba35-9d436b129529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.370548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de1e21-e07b-4428-ba35-9d436b129529 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.382517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 979/1975] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:34.420184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 997/1976] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:34.423653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b475f05-e1a0-49ea-848d-c6b0c3547ef5 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.437838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b475f05-e1a0-49ea-848d-c6b0c3547ef5 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.444870 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0f425-da76-4a94-a7cd-e43bf706b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.448005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f425-da76-4a94-a7cd-e43bf706b3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.448005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f425-da76-4a94-a7cd-e43bf706b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.448005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f425-da76-4a94-a7cd-e43bf706b3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.448005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0f425-da76-4a94-a7cd-e43bf706b3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.457038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0f425-da76-4a94-a7cd-e43bf706b3c4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.471665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 980/1977] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:34.476909 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1e21-e07b-4428-ba35-9d436b129529 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.489776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1e21-e07b-4428-ba35-9d436b129529 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.496939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac52b-3633-4a9a-91bc-633298cf84d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.497916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac52b-3633-4a9a-91bc-633298cf84d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.498256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac52b-3633-4a9a-91bc-633298cf84d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.498590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac52b-3633-4a9a-91bc-633298cf84d6 admin admin] PATH_INFO: `/v3/projects/c8c6b77eb3a44029ae5d698756566217/users/4f20e6c5789d40a181895e736d2c7221/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.518613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac52b-3633-4a9a-91bc-633298cf84d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6b77eb3a44029ae5d698756566217, user_id=4f20e6c5789d40a181895e736d2c7221, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.522336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac52b-3633-4a9a-91bc-633298cf84d6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.535047 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:34.631589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 998/1978] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:34 2022] PUT /identity/v3/projects/c8c6b77eb3a44029ae5d698756566217/users/4f20e6c5789d40a181895e736d2c7221/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:34.642865 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eecb3-6513-47c2-9045-0c84fe458e94 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.643158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eecb3-6513-47c2-9045-0c84fe458e94 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.643437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eecb3-6513-47c2-9045-0c84fe458e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.673252 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-643eecb3-6513-47c2-9045-0c84fe458e94 None None] MFA Rules not processed for user `4f20e6c5789d40a181895e736d2c7221`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:34.674610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-643eecb3-6513-47c2-9045-0c84fe458e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:34.746376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 981/1979] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:34.751109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac52b-3633-4a9a-91bc-633298cf84d6 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.761908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eecb3-6513-47c2-9045-0c84fe458e94 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:34.763454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-643eecb3-6513-47c2-9045-0c84fe458e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:34.841629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eecb3-6513-47c2-9045-0c84fe458e94 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.846651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884010f-c91b-41c4-b1f9-fbae1bdd74c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.847507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884010f-c91b-41c4-b1f9-fbae1bdd74c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.847794 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884010f-c91b-41c4-b1f9-fbae1bdd74c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.848089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884010f-c91b-41c4-b1f9-fbae1bdd74c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.850028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5884010f-c91b-41c4-b1f9-fbae1bdd74c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:34.864775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac52b-3633-4a9a-91bc-633298cf84d6 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:34.875099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d869-9265-4f1f-8d4d-397690871295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:34.875795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d869-9265-4f1f-8d4d-397690871295 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:34.876108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d869-9265-4f1f-8d4d-397690871295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:34.876390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d869-9265-4f1f-8d4d-397690871295 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:34.877626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d869-9265-4f1f-8d4d-397690871295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.879939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d869-9265-4f1f-8d4d-397690871295 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:34.988626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884010f-c91b-41c4-b1f9-fbae1bdd74c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:34.992237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884010f-c91b-41c4-b1f9-fbae1bdd74c7 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:35.009344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 999/1980] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:34 2022] POST /identity/v3/projects => generated 383 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:35.014612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 982/1981] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:40:35.015610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d869-9265-4f1f-8d4d-397690871295 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:35.133272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d869-9265-4f1f-8d4d-397690871295 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:35.142316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c00f1-65f2-4795-b647-608b924072ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:35.143245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c00f1-65f2-4795-b647-608b924072ff admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:35.149958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c00f1-65f2-4795-b647-608b924072ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:35.149958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c00f1-65f2-4795-b647-608b924072ff admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:35.149958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c00f1-65f2-4795-b647-608b924072ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:35.149958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c00f1-65f2-4795-b647-608b924072ff admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:35.355739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1000/1982] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:35 2022] POST /identity/v3/users => generated 292 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:35.357800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884010f-c91b-41c4-b1f9-fbae1bdd74c7 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:35.374140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884010f-c91b-41c4-b1f9-fbae1bdd74c7 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:35.384335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85906e-6d15-43ed-b9a1-c2301a1a11fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:35.385053 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85906e-6d15-43ed-b9a1-c2301a1a11fa admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:35.385869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85906e-6d15-43ed-b9a1-c2301a1a11fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:35.385869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85906e-6d15-43ed-b9a1-c2301a1a11fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:35.386502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85906e-6d15-43ed-b9a1-c2301a1a11fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:35.388165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85906e-6d15-43ed-b9a1-c2301a1a11fa admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:35.405355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 983/1983] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:35.406934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c00f1-65f2-4795-b647-608b924072ff admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:35.418766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c00f1-65f2-4795-b647-608b924072ff admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:35.424425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72320a5-c8a5-43fb-ae65-5e7ad27b274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:35.431328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72320a5-c8a5-43fb-ae65-5e7ad27b274e admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:35.431328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72320a5-c8a5-43fb-ae65-5e7ad27b274e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:35.431328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72320a5-c8a5-43fb-ae65-5e7ad27b274e admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:35.431328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72320a5-c8a5-43fb-ae65-5e7ad27b274e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:35.431328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72320a5-c8a5-43fb-ae65-5e7ad27b274e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:35.440682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1001/1984] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:35.446093 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85906e-6d15-43ed-b9a1-c2301a1a11fa admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:35.461731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85906e-6d15-43ed-b9a1-c2301a1a11fa admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:35.463977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:35.470145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53f0e3-a82e-4b0c-aeff-6b045d29aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:35.472647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f0e3-a82e-4b0c-aeff-6b045d29aded admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:35.473778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f0e3-a82e-4b0c-aeff-6b045d29aded admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:35.473778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f0e3-a82e-4b0c-aeff-6b045d29aded admin admin] PATH_INFO: `/v3/projects/1e930d04a6f14832ad6ce1ae11bfe6a5/users/ea4fae792ff84173b48a8507e1a28ab7/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:35.501486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53f0e3-a82e-4b0c-aeff-6b045d29aded admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e930d04a6f14832ad6ce1ae11bfe6a5, user_id=ea4fae792ff84173b48a8507e1a28ab7, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:35.504658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53f0e3-a82e-4b0c-aeff-6b045d29aded admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:35.671332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 984/1985] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:35 2022] PUT /identity/v3/projects/1e930d04a6f14832ad6ce1ae11bfe6a5/users/ea4fae792ff84173b48a8507e1a28ab7/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:35.687982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c56072-b953-4ae2-aa84-188b7a3ff36a None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:35.688541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c56072-b953-4ae2-aa84-188b7a3ff36a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:35.689029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c56072-b953-4ae2-aa84-188b7a3ff36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:35.730823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-f7c56072-b953-4ae2-aa84-188b7a3ff36a None None] MFA Rules not processed for user `ea4fae792ff84173b48a8507e1a28ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:35.734465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f7c56072-b953-4ae2-aa84-188b7a3ff36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:35.847040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1002/1986] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:35.851998 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53f0e3-a82e-4b0c-aeff-6b045d29aded admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:35.957857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53f0e3-a82e-4b0c-aeff-6b045d29aded admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:35.970012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f568c-2602-4c96-96a8-1b72a273f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:35.970717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f568c-2602-4c96-96a8-1b72a273f463 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:35.970994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f568c-2602-4c96-96a8-1b72a273f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:35.971270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f568c-2602-4c96-96a8-1b72a273f463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:35.971964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f568c-2602-4c96-96a8-1b72a273f463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:35.978414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f568c-2602-4c96-96a8-1b72a273f463 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:36.098761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 985/1987] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:35 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:36.104295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c56072-b953-4ae2-aa84-188b7a3ff36a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:36.128272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c56072-b953-4ae2-aa84-188b7a3ff36a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:36.294549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e01fa-f147-41b1-bc72-21f9f1632443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:36.295868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e01fa-f147-41b1-bc72-21f9f1632443 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:36.296976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e01fa-f147-41b1-bc72-21f9f1632443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:36.300553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e01fa-f147-41b1-bc72-21f9f1632443 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:36.301867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e01fa-f147-41b1-bc72-21f9f1632443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:36.308103 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e01fa-f147-41b1-bc72-21f9f1632443 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:36.472270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1003/1988] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:36 2022] POST /identity/v3/users => generated 299 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:36.479620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f568c-2602-4c96-96a8-1b72a273f463 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:36.515319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f568c-2602-4c96-96a8-1b72a273f463 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:36.529832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b56a1-12f2-4601-8ba9-5644df7a5bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:36.531207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b56a1-12f2-4601-8ba9-5644df7a5bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:36.532510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b56a1-12f2-4601-8ba9-5644df7a5bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:36.533264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b56a1-12f2-4601-8ba9-5644df7a5bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:36.534730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b56a1-12f2-4601-8ba9-5644df7a5bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:36.537670 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b56a1-12f2-4601-8ba9-5644df7a5bb9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:36.555839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:36.562463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 986/1989] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:36.563851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e01fa-f147-41b1-bc72-21f9f1632443 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:36.604847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e01fa-f147-41b1-bc72-21f9f1632443 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:36.623674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce0f9e-e43b-4690-b185-ab1409db7a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:36.630429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce0f9e-e43b-4690-b185-ab1409db7a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:36.630429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce0f9e-e43b-4690-b185-ab1409db7a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:36.630429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce0f9e-e43b-4690-b185-ab1409db7a1a admin admin] PATH_INFO: `/v3/projects/6c7eb7488c4f496baf938a40755726d0/users/e2d08b5e5c734b42b6f500bbf22e30a8/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:36.678889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce0f9e-e43b-4690-b185-ab1409db7a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7eb7488c4f496baf938a40755726d0, user_id=e2d08b5e5c734b42b6f500bbf22e30a8, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:36.682731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce0f9e-e43b-4690-b185-ab1409db7a1a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:36.821099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1004/1990] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:36 2022] PUT /identity/v3/projects/6c7eb7488c4f496baf938a40755726d0/users/e2d08b5e5c734b42b6f500bbf22e30a8/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:36.825442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b56a1-12f2-4601-8ba9-5644df7a5bb9 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:36.837316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b56a1-12f2-4601-8ba9-5644df7a5bb9 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:36.939242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa43ec-5d7f-4900-a287-136fbcc6d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:36.940418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa43ec-5d7f-4900-a287-136fbcc6d45c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:36.940911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa43ec-5d7f-4900-a287-136fbcc6d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:36.941401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa43ec-5d7f-4900-a287-136fbcc6d45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:36.942744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa43ec-5d7f-4900-a287-136fbcc6d45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:36.945760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa43ec-5d7f-4900-a287-136fbcc6d45c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:36.963021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 987/1991] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:36.967611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce0f9e-e43b-4690-b185-ab1409db7a1a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:36.983572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce0f9e-e43b-4690-b185-ab1409db7a1a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:36.988846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dfba5-f34b-4d02-9e80-a95b38624b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:36.989767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dfba5-f34b-4d02-9e80-a95b38624b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:36.990052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dfba5-f34b-4d02-9e80-a95b38624b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:36.990331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dfba5-f34b-4d02-9e80-a95b38624b36 admin admin] PATH_INFO: `/v3/projects/6c7eb7488c4f496baf938a40755726d0/users/e2d08b5e5c734b42b6f500bbf22e30a8/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:36.993078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dfba5-f34b-4d02-9e80-a95b38624b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7eb7488c4f496baf938a40755726d0, user_id=e2d08b5e5c734b42b6f500bbf22e30a8, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:36.996390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dfba5-f34b-4d02-9e80-a95b38624b36 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:37.015634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1005/1992] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:36 2022] PUT /identity/v3/projects/6c7eb7488c4f496baf938a40755726d0/users/e2d08b5e5c734b42b6f500bbf22e30a8/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:37.032828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08418ca-6c34-498b-ad11-9e4ff359544c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:37.032828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08418ca-6c34-498b-ad11-9e4ff359544c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:37.033553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08418ca-6c34-498b-ad11-9e4ff359544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:37.064660 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d08418ca-6c34-498b-ad11-9e4ff359544c None None] MFA Rules not processed for user `e2d08b5e5c734b42b6f500bbf22e30a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:37.065907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d08418ca-6c34-498b-ad11-9e4ff359544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:37.144575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 988/1993] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:37.157610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dfba5-f34b-4d02-9e80-a95b38624b36 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:37.226027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dfba5-f34b-4d02-9e80-a95b38624b36 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:37.229723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcd630-2a5d-4e90-9130-1a0643855746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:37.230375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcd630-2a5d-4e90-9130-1a0643855746 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:37.230654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcd630-2a5d-4e90-9130-1a0643855746 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:37.230925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcd630-2a5d-4e90-9130-1a0643855746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:37.291906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcd630-2a5d-4e90-9130-1a0643855746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:37.293364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcd630-2a5d-4e90-9130-1a0643855746 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:37.302538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1006/1994] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:37.588267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:38.560556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:40.659629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08418ca-6c34-498b-ad11-9e4ff359544c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:40.669642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08418ca-6c34-498b-ad11-9e4ff359544c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:40.673326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b22d6-ab07-4410-ae61-eb63ac0dbfb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:40.673965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b22d6-ab07-4410-ae61-eb63ac0dbfb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:40.674247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b22d6-ab07-4410-ae61-eb63ac0dbfb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:40.674517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b22d6-ab07-4410-ae61-eb63ac0dbfb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:40.732725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b22d6-ab07-4410-ae61-eb63ac0dbfb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:40.734167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b22d6-ab07-4410-ae61-eb63ac0dbfb3 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:40.743947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 989/1995] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:41.088264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:42.500479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:42.916709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcd630-2a5d-4e90-9130-1a0643855746 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:42.932419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcd630-2a5d-4e90-9130-1a0643855746 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:42.938991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9deca-e52e-4ce1-8255-6dedb36d6460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:42.940148 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9deca-e52e-4ce1-8255-6dedb36d6460 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:42.940657 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9deca-e52e-4ce1-8255-6dedb36d6460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:42.941190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9deca-e52e-4ce1-8255-6dedb36d6460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:42.962757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9deca-e52e-4ce1-8255-6dedb36d6460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:42.965623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9deca-e52e-4ce1-8255-6dedb36d6460 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:42.984361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1007/1996] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:43.463482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:45.765187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b22d6-ab07-4410-ae61-eb63ac0dbfb3 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:45.831594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b22d6-ab07-4410-ae61-eb63ac0dbfb3 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:45.837795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:45.838713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:45.839006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:45.839323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] PATH_INFO: `/v3/users/06ac2b7c50fb42f6a6dd261b76c71dc5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:45.840563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ac2b7c50fb42f6a6dd261b76c71dc5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:45.842568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:45.875491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:45.978636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:46.097343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ac2b7c50fb42f6a6dd261b76c71dc5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:46.111762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ac2b7c50fb42f6a6dd261b76c71dc5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:46.177922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ac2b7c50fb42f6a6dd261b76c71dc5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:46.178682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ac2b7c50fb42f6a6dd261b76c71dc5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:46.180118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ac2b7c50fb42f6a6dd261b76c71dc5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:46.194263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 990/1997] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:45 2022] DELETE /identity/v3/users/06ac2b7c50fb42f6a6dd261b76c71dc5 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:46.199663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa977e8-f9c0-4849-a558-e8cc8dc2d889 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:46.200023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa977e8-f9c0-4849-a558-e8cc8dc2d889 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:46.200438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa977e8-f9c0-4849-a558-e8cc8dc2d889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:46.222868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6fa977e8-f9c0-4849-a558-e8cc8dc2d889 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:46.224219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6fa977e8-f9c0-4849-a558-e8cc8dc2d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:46.303662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1008/1998] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:46.313886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:46.315318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:46.382950 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0ba3f-2af1-4383-835b-e05304882361 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:46.386725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f433f74-db45-4666-909e-bbdf53b80306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:46.387385 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f433f74-db45-4666-909e-bbdf53b80306 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:46.387820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f433f74-db45-4666-909e-bbdf53b80306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:46.388128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f433f74-db45-4666-909e-bbdf53b80306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:46.398913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f433f74-db45-4666-909e-bbdf53b80306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:46.400408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f433f74-db45-4666-909e-bbdf53b80306 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:46.420910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 991/1999] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:47.317104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa977e8-f9c0-4849-a558-e8cc8dc2d889 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:47.319526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6fa977e8-f9c0-4849-a558-e8cc8dc2d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:47.503045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa977e8-f9c0-4849-a558-e8cc8dc2d889 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:47.504885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:47.505823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:47.506099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:47.506647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] PATH_INFO: `/v3/projects/a4a798ee5eff4c6ba5764ed0c99bbc22` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:47.508359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a798ee5eff4c6ba5764ed0c99bbc22)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:47.510469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:47.529610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:47.667420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a798ee5eff4c6ba5764ed0c99bbc22', 'request_id': 'req-33b8f71b-f9b3-4223-b744-8e51daa41f26'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:47.687395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a798ee5eff4c6ba5764ed0c99bbc22', 'request_id': 'req-33b8f71b-f9b3-4223-b744-8e51daa41f26'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:47.695746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a798ee5eff4c6ba5764ed0c99bbc22', 'request_id': 'req-33b8f71b-f9b3-4223-b744-8e51daa41f26'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:47.938506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] The token cache is being invalidate because project a4a798ee5eff4c6ba5764ed0c99bbc22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:47.939060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:47.940109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:47.943113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1009/2000] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:47 2022] DELETE /identity/v3/projects/a4a798ee5eff4c6ba5764ed0c99bbc22 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:47.949442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f433f74-db45-4666-909e-bbdf53b80306 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:48.009684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f433f74-db45-4666-909e-bbdf53b80306 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:48.080004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:48.081912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:48.082268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:48.085860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] PATH_INFO: `/v3/users/8e9a30b4f3eb47cb9408580be07f258e` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:48.085860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e9a30b4f3eb47cb9408580be07f258e)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:48.089578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:48.418776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e9a30b4f3eb47cb9408580be07f258e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:48.441839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e9a30b4f3eb47cb9408580be07f258e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:48.450172 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:48.520147 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e9a30b4f3eb47cb9408580be07f258e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:48.529768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e9a30b4f3eb47cb9408580be07f258e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:48.531123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6bd8f07d-ac95-44d5-acb7-59f20a4fe0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e9a30b4f3eb47cb9408580be07f258e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:48.571204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 992/2001] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:47 2022] DELETE /identity/v3/users/8e9a30b4f3eb47cb9408580be07f258e => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:48.921361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:49.059598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:49.061379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:49.080894 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8f71b-f9b3-4223-b744-8e51daa41f26 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:49.149036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:49.151368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:49.151368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:49.151368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] PATH_INFO: `/v3/projects/9b21cdb85c2a421d9a0c81b20d3010a2` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:49.152381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b21cdb85c2a421d9a0c81b20d3010a2)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:49.154376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:49.329398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b21cdb85c2a421d9a0c81b20d3010a2', 'request_id': 'req-7ec4b175-c263-4b51-915c-a63ca9d24f8a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:49.336138 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b21cdb85c2a421d9a0c81b20d3010a2', 'request_id': 'req-7ec4b175-c263-4b51-915c-a63ca9d24f8a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:49.342685 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b21cdb85c2a421d9a0c81b20d3010a2', 'request_id': 'req-7ec4b175-c263-4b51-915c-a63ca9d24f8a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:49.469413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] The token cache is being invalidate because project 9b21cdb85c2a421d9a0c81b20d3010a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:49.469925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:49.470658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:49.472978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1010/2002] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:49 2022] DELETE /identity/v3/projects/9b21cdb85c2a421d9a0c81b20d3010a2 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:49.490898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b89a-1f0a-4313-9619-cc8d96502d5a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:49.490898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b89a-1f0a-4313-9619-cc8d96502d5a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:49.490898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b89a-1f0a-4313-9619-cc8d96502d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:49.542004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5ef4b89a-1f0a-4313-9619-cc8d96502d5a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:49.542004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5ef4b89a-1f0a-4313-9619-cc8d96502d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:49.553441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:49.556130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:49.633891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4b175-c263-4b51-915c-a63ca9d24f8a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:49.641134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 993/2003] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:49.641764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:49.642926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:49.643247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:49.644531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] PATH_INFO: `/v3/users/4f20e6c5789d40a181895e736d2c7221` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:49.645228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23490f0-8b21-4034-8085-e213b4195298 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:49.645713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23490f0-8b21-4034-8085-e213b4195298 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:49.646034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23490f0-8b21-4034-8085-e213b4195298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:49.647043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f20e6c5789d40a181895e736d2c7221)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:49.651018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:49.667904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e23490f0-8b21-4034-8085-e213b4195298 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:49.669504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e23490f0-8b21-4034-8085-e213b4195298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:49.678360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 994/2004] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:49.683647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23490f0-8b21-4034-8085-e213b4195298 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:49.697981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23490f0-8b21-4034-8085-e213b4195298 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:49.703018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057190-a9e4-466a-8c93-5838d56f50f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:49.703728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057190-a9e4-466a-8c93-5838d56f50f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:49.704016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057190-a9e4-466a-8c93-5838d56f50f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:49.704343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057190-a9e4-466a-8c93-5838d56f50f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:49.705077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d057190-a9e4-466a-8c93-5838d56f50f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:49.705382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d057190-a9e4-466a-8c93-5838d56f50f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:49.706993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d057190-a9e4-466a-8c93-5838d56f50f8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:49.721430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 995/2005] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:49.726748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057190-a9e4-466a-8c93-5838d56f50f8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:49.737782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:49.743404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057190-a9e4-466a-8c93-5838d56f50f8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:49.746910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae850d-b430-40cc-abac-c084202cd8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:49.747583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae850d-b430-40cc-abac-c084202cd8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:49.748266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae850d-b430-40cc-abac-c084202cd8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:49.748266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae850d-b430-40cc-abac-c084202cd8e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:49.748856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae850d-b430-40cc-abac-c084202cd8e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:49.750765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae850d-b430-40cc-abac-c084202cd8e7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:49.848411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 996/2006] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:49 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:49.853159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae850d-b430-40cc-abac-c084202cd8e7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:49.916178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae850d-b430-40cc-abac-c084202cd8e7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:49.920993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de68dcf-c50c-4453-9927-b18d17e5303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:49.921663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de68dcf-c50c-4453-9927-b18d17e5303e admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:49.921946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de68dcf-c50c-4453-9927-b18d17e5303e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:49.922223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de68dcf-c50c-4453-9927-b18d17e5303e admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:49.922904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de68dcf-c50c-4453-9927-b18d17e5303e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:49.924849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de68dcf-c50c-4453-9927-b18d17e5303e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:49.934808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f20e6c5789d40a181895e736d2c7221'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:49.947817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f20e6c5789d40a181895e736d2c7221'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:50.063938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 997/2007] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:49 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:50.068101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de68dcf-c50c-4453-9927-b18d17e5303e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:50.078536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de68dcf-c50c-4453-9927-b18d17e5303e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:50.083445 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe20eb6-fc58-467e-8f0c-d22cbc130b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:50.084140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe20eb6-fc58-467e-8f0c-d22cbc130b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:50.084448 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe20eb6-fc58-467e-8f0c-d22cbc130b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:50.084697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe20eb6-fc58-467e-8f0c-d22cbc130b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:50.085696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe20eb6-fc58-467e-8f0c-d22cbc130b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:50.087272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f20e6c5789d40a181895e736d2c7221'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:50.087422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe20eb6-fc58-467e-8f0c-d22cbc130b6c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:50.088363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f20e6c5789d40a181895e736d2c7221'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:50.091212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-de11b74f-8808-4f7c-8944-6648268faa55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f20e6c5789d40a181895e736d2c7221'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:50.100361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 998/2008] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:50.105713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe20eb6-fc58-467e-8f0c-d22cbc130b6c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:50.107542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ebe20eb6-fc58-467e-8f0c-d22cbc130b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:50.115976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1011/2009] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:49 2022] DELETE /identity/v3/users/4f20e6c5789d40a181895e736d2c7221 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:50.121426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d84850-f5e2-4c40-a330-6490c8dd2e10 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:50.122256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d84850-f5e2-4c40-a330-6490c8dd2e10 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:50.122912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d84850-f5e2-4c40-a330-6490c8dd2e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:50.125029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe20eb6-fc58-467e-8f0c-d22cbc130b6c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:50.160361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-59d84850-f5e2-4c40-a330-6490c8dd2e10 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:50.163487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-59d84850-f5e2-4c40-a330-6490c8dd2e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:50.206883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d3783-14d6-463a-981d-ea477d58a30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:50.207679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d3783-14d6-463a-981d-ea477d58a30d admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:50.208400 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d3783-14d6-463a-981d-ea477d58a30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:50.208808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d3783-14d6-463a-981d-ea477d58a30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:50.209635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d3783-14d6-463a-981d-ea477d58a30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:50.212136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d3783-14d6-463a-981d-ea477d58a30d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:50.222382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 999/2010] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:50.227737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d3783-14d6-463a-981d-ea477d58a30d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:50.239734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d3783-14d6-463a-981d-ea477d58a30d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:50.250841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780cee4-6deb-4d1f-9ea1-0e04200067d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:50.251992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780cee4-6deb-4d1f-9ea1-0e04200067d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:50.252408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780cee4-6deb-4d1f-9ea1-0e04200067d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:50.252789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780cee4-6deb-4d1f-9ea1-0e04200067d2 admin admin] PATH_INFO: `/v3/projects/fe70bbba5f0d4d6ca4776565980ca8fb/users/6ced3215b54a4850982fcebe3a0b30e1/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:50.266332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1012/2011] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:50.281422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d84850-f5e2-4c40-a330-6490c8dd2e10 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:50.281673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780cee4-6deb-4d1f-9ea1-0e04200067d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe70bbba5f0d4d6ca4776565980ca8fb, user_id=6ced3215b54a4850982fcebe3a0b30e1, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:50.283376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-59d84850-f5e2-4c40-a330-6490c8dd2e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:50.284995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780cee4-6deb-4d1f-9ea1-0e04200067d2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:50.385309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1000/2012] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:50 2022] PUT /identity/v3/projects/fe70bbba5f0d4d6ca4776565980ca8fb/users/6ced3215b54a4850982fcebe3a0b30e1/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:50.410062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc1853-4ad8-4578-9379-eacafd223923 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:50.410339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc1853-4ad8-4578-9379-eacafd223923 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:50.410601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc1853-4ad8-4578-9379-eacafd223923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:50.439109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d84850-f5e2-4c40-a330-6490c8dd2e10 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:50.458226 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8ccc1853-4ad8-4578-9379-eacafd223923 None None] MFA Rules not processed for user `6ced3215b54a4850982fcebe3a0b30e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:50.460377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8ccc1853-4ad8-4578-9379-eacafd223923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:50.498806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26a955-d264-4c94-bc78-b200ada2e617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:50.499481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26a955-d264-4c94-bc78-b200ada2e617 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:50.499768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26a955-d264-4c94-bc78-b200ada2e617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:50.500044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26a955-d264-4c94-bc78-b200ada2e617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:50.542877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1001/2013] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:50.553005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc1853-4ad8-4578-9379-eacafd223923 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:50.576257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26a955-d264-4c94-bc78-b200ada2e617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:50.577861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26a955-d264-4c94-bc78-b200ada2e617 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:50.590342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1013/2014] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:40:50.625541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc1853-4ad8-4578-9379-eacafd223923 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:50.630256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedde8f-6858-4530-985c-a1520618d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:50.630940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedde8f-6858-4530-985c-a1520618d3ee admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:50.631251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedde8f-6858-4530-985c-a1520618d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:50.631517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedde8f-6858-4530-985c-a1520618d3ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:50.633066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedde8f-6858-4530-985c-a1520618d3ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:50.635099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedde8f-6858-4530-985c-a1520618d3ee admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:50.767815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1002/2015] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:50 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:50.771977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26a955-d264-4c94-bc78-b200ada2e617 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:50.782615 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26a955-d264-4c94-bc78-b200ada2e617 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:50.868296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07133f1f-e3a0-4f84-b95f-bd8cb1bbc992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:50.869143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07133f1f-e3a0-4f84-b95f-bd8cb1bbc992 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:50.869534 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07133f1f-e3a0-4f84-b95f-bd8cb1bbc992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:50.869910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07133f1f-e3a0-4f84-b95f-bd8cb1bbc992 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:50.870723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07133f1f-e3a0-4f84-b95f-bd8cb1bbc992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:50.872886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07133f1f-e3a0-4f84-b95f-bd8cb1bbc992 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:50.987472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1014/2016] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:50 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:50.988880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedde8f-6858-4530-985c-a1520618d3ee admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:51.001184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedde8f-6858-4530-985c-a1520618d3ee admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:51.006040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c54c4-3d07-4448-a1bf-74c0d145c3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:51.006970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c54c4-3d07-4448-a1bf-74c0d145c3db admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:51.007764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c54c4-3d07-4448-a1bf-74c0d145c3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:51.007764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c54c4-3d07-4448-a1bf-74c0d145c3db admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:51.008339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c54c4-3d07-4448-a1bf-74c0d145c3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:51.010000 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c54c4-3d07-4448-a1bf-74c0d145c3db admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:51.021853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1003/2017] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:51.034031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07133f1f-e3a0-4f84-b95f-bd8cb1bbc992 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:51.046584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07133f1f-e3a0-4f84-b95f-bd8cb1bbc992 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:51.051451 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c759d5-9478-416c-baca-d25cf7f27547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:51.052610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c759d5-9478-416c-baca-d25cf7f27547 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:51.056212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c759d5-9478-416c-baca-d25cf7f27547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:51.056212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c759d5-9478-416c-baca-d25cf7f27547 admin admin] PATH_INFO: `/v3/projects/e09172ac151b4d5c84188661c9be291e/users/96d5bccfee5542079beef3320a048ba5/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:51.074975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c759d5-9478-416c-baca-d25cf7f27547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09172ac151b4d5c84188661c9be291e, user_id=96d5bccfee5542079beef3320a048ba5, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:51.077701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c759d5-9478-416c-baca-d25cf7f27547 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:51.092370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:51.184749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:51.192300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1015/2018] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:51 2022] PUT /identity/v3/projects/e09172ac151b4d5c84188661c9be291e/users/96d5bccfee5542079beef3320a048ba5/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:51.199876 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c54c4-3d07-4448-a1bf-74c0d145c3db admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:51.202665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c759d5-9478-416c-baca-d25cf7f27547 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:51.210445 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7d4c54c4-3d07-4448-a1bf-74c0d145c3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:51.232813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c54c4-3d07-4448-a1bf-74c0d145c3db admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:51.297762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c759d5-9478-416c-baca-d25cf7f27547 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:51.303247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeabb96-8b66-485a-a3e7-388bfd74305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:51.304031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabb96-8b66-485a-a3e7-388bfd74305f admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:51.304784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabb96-8b66-485a-a3e7-388bfd74305f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:51.304784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabb96-8b66-485a-a3e7-388bfd74305f admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:51.305698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeabb96-8b66-485a-a3e7-388bfd74305f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:51.308114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeabb96-8b66-485a-a3e7-388bfd74305f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:51.313239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:51.314610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:51.315048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:51.315651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] PATH_INFO: `/v3/projects/c8c6b77eb3a44029ae5d698756566217` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:51.317076 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c6b77eb3a44029ae5d698756566217)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:51.319378 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:51.321194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1016/2019] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:51.322194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeabb96-8b66-485a-a3e7-388bfd74305f admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:51.324263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-faeabb96-8b66-485a-a3e7-388bfd74305f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:51.346858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeabb96-8b66-485a-a3e7-388bfd74305f admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:51.354313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:51.355220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:51.355508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:51.355785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] PATH_INFO: `/v3/users/8150ca40b3264dc7a67b7af140583ccd` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:51.357079 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8150ca40b3264dc7a67b7af140583ccd)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:51.359015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:51.579545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8150ca40b3264dc7a67b7af140583ccd'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:51.580437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c6b77eb3a44029ae5d698756566217', 'request_id': 'req-7c3002ac-d288-4331-9a3e-165e0b7f95ac'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:51.587080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c6b77eb3a44029ae5d698756566217', 'request_id': 'req-7c3002ac-d288-4331-9a3e-165e0b7f95ac'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:51.595755 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8150ca40b3264dc7a67b7af140583ccd'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:51.652342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c6b77eb3a44029ae5d698756566217', 'request_id': 'req-7c3002ac-d288-4331-9a3e-165e0b7f95ac'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:51.666605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] The token cache is being invalidate because project c8c6b77eb3a44029ae5d698756566217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:51.666977 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:51.667726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:51.669472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1004/2020] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:51 2022] DELETE /identity/v3/projects/c8c6b77eb3a44029ae5d698756566217 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:51.670269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:51.672055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:51.709482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8150ca40b3264dc7a67b7af140583ccd'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:51.711300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8150ca40b3264dc7a67b7af140583ccd'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:51.711706 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8150ca40b3264dc7a67b7af140583ccd'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:51.728755 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1017/2021] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:51 2022] DELETE /identity/v3/users/8150ca40b3264dc7a67b7af140583ccd => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:51.729605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:51.731039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:51.751754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3002ac-d288-4331-9a3e-165e0b7f95ac admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:51.808378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbd393-b459-424d-be3c-8dac89a8b775 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:51.813374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:51.814460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:51.814747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:51.815134 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] PATH_INFO: `/v3/users/ea4fae792ff84173b48a8507e1a28ab7` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:51.816717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af60b5d-4ae6-4495-af5a-507d57d9d544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:51.817658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60b5d-4ae6-4495-af5a-507d57d9d544 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:51.817769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4fae792ff84173b48a8507e1a28ab7)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:51.818068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60b5d-4ae6-4495-af5a-507d57d9d544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:51.818245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60b5d-4ae6-4495-af5a-507d57d9d544 admin admin] PATH_INFO: `/v3/projects/e09172ac151b4d5c84188661c9be291e/users/96d5bccfee5542079beef3320a048ba5/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:51.820319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:51.821976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60b5d-4ae6-4495-af5a-507d57d9d544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09172ac151b4d5c84188661c9be291e, user_id=96d5bccfee5542079beef3320a048ba5, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:51.824446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60b5d-4ae6-4495-af5a-507d57d9d544 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:51.836382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1005/2022] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:51 2022] PUT /identity/v3/projects/e09172ac151b4d5c84188661c9be291e/users/96d5bccfee5542079beef3320a048ba5/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:51.838202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1678a81-c0ff-47d3-a8b2-3391edfd2f28 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:51.838487 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1678a81-c0ff-47d3-a8b2-3391edfd2f28 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:51.838773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1678a81-c0ff-47d3-a8b2-3391edfd2f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:51.858097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c1678a81-c0ff-47d3-a8b2-3391edfd2f28 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:51.860948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c1678a81-c0ff-47d3-a8b2-3391edfd2f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:51.921684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1006/2023] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:51.922967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e07c8-bd41-4ce1-a7d4-7c10b15cf7a5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:51.923334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e07c8-bd41-4ce1-a7d4-7c10b15cf7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:51.923620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e07c8-bd41-4ce1-a7d4-7c10b15cf7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:51.953550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-551e07c8-bd41-4ce1-a7d4-7c10b15cf7a5 None None] MFA Rules not processed for user `96d5bccfee5542079beef3320a048ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:51.954749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-551e07c8-bd41-4ce1-a7d4-7c10b15cf7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:52.026068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1007/2024] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:52.026916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e07c8-bd41-4ce1-a7d4-7c10b15cf7a5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:52.028272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-551e07c8-bd41-4ce1-a7d4-7c10b15cf7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:52.090342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e07c8-bd41-4ce1-a7d4-7c10b15cf7a5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:52.094625 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d247b70-cce0-4bcd-88f2-8011b6068760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:52.095402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247b70-cce0-4bcd-88f2-8011b6068760 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:52.095773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247b70-cce0-4bcd-88f2-8011b6068760 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:52.096312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247b70-cce0-4bcd-88f2-8011b6068760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:52.107951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d247b70-cce0-4bcd-88f2-8011b6068760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:52.109419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d247b70-cce0-4bcd-88f2-8011b6068760 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:52.120425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1008/2025] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:52.121360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d247b70-cce0-4bcd-88f2-8011b6068760 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:52.122728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4d247b70-cce0-4bcd-88f2-8011b6068760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:52.144334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4fae792ff84173b48a8507e1a28ab7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:52.157381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4fae792ff84173b48a8507e1a28ab7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:52.187046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d247b70-cce0-4bcd-88f2-8011b6068760 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:52.190992 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677192df-ddd7-435d-82f6-1a09befd7bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:52.191658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677192df-ddd7-435d-82f6-1a09befd7bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:52.191942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677192df-ddd7-435d-82f6-1a09befd7bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:52.192254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677192df-ddd7-435d-82f6-1a09befd7bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:52.203150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677192df-ddd7-435d-82f6-1a09befd7bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:52.205362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677192df-ddd7-435d-82f6-1a09befd7bc2 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:52.216427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1009/2026] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:52.220375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:52.343906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4fae792ff84173b48a8507e1a28ab7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:52.344564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4fae792ff84173b48a8507e1a28ab7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:52.345180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4fae792ff84173b48a8507e1a28ab7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:52.358944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1018/2027] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:51 2022] DELETE /identity/v3/users/ea4fae792ff84173b48a8507e1a28ab7 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:52.492775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:52.550225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677192df-ddd7-435d-82f6-1a09befd7bc2 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:52.565438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677192df-ddd7-435d-82f6-1a09befd7bc2 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:52.619305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38368e-3c2a-414c-b950-cb5416a59a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:52.619971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38368e-3c2a-414c-b950-cb5416a59a30 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:52.620295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38368e-3c2a-414c-b950-cb5416a59a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:52.620572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38368e-3c2a-414c-b950-cb5416a59a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:52.622519 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4b38368e-3c2a-414c-b950-cb5416a59a30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:52.706296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38368e-3c2a-414c-b950-cb5416a59a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:52.708055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38368e-3c2a-414c-b950-cb5416a59a30 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:52.719407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1010/2028] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:52.930570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:52.932385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:53.003297 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38368e-3c2a-414c-b950-cb5416a59a30 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:53.010393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4b38368e-3c2a-414c-b950-cb5416a59a30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:53.127195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6cce8-f6da-4a06-b2d2-80aa648efaae admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:53.134906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:53.135961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:53.136414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:53.136730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] PATH_INFO: `/v3/projects/fdee7590a6d745f181a500bd3b3f6e43` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:53.138135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdee7590a6d745f181a500bd3b3f6e43)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:53.140466 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:53.150669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38368e-3c2a-414c-b950-cb5416a59a30 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:53.156609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:53.157595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:53.157883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:53.158161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] PATH_INFO: `/v3/projects/1e930d04a6f14832ad6ce1ae11bfe6a5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:53.159402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e930d04a6f14832ad6ce1ae11bfe6a5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:53.161582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:53.262018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdee7590a6d745f181a500bd3b3f6e43', 'request_id': 'req-ca83e8c6-4765-47a6-8d5e-241bc506de46'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.272222 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdee7590a6d745f181a500bd3b3f6e43', 'request_id': 'req-ca83e8c6-4765-47a6-8d5e-241bc506de46'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.280584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdee7590a6d745f181a500bd3b3f6e43', 'request_id': 'req-ca83e8c6-4765-47a6-8d5e-241bc506de46'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.323517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e930d04a6f14832ad6ce1ae11bfe6a5', 'request_id': 'req-65f87065-5b7c-4ec2-b73d-84cc28a37160'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.329272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e930d04a6f14832ad6ce1ae11bfe6a5', 'request_id': 'req-65f87065-5b7c-4ec2-b73d-84cc28a37160'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.395104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] The token cache is being invalidate because project fdee7590a6d745f181a500bd3b3f6e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:53.395500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.396171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.398112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1019/2029] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:52 2022] DELETE /identity/v3/projects/fdee7590a6d745f181a500bd3b3f6e43 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:53.402532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:53.404378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:53.446806 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e930d04a6f14832ad6ce1ae11bfe6a5', 'request_id': 'req-65f87065-5b7c-4ec2-b73d-84cc28a37160'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.461751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] The token cache is being invalidate because project 1e930d04a6f14832ad6ce1ae11bfe6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:53.462048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.462847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.465690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1011/2030] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:53 2022] DELETE /identity/v3/projects/1e930d04a6f14832ad6ce1ae11bfe6a5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:53.468712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:53.470095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:53.482296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83e8c6-4765-47a6-8d5e-241bc506de46 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:53.550389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:53.551791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:53.552104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:53.552401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] PATH_INFO: `/v3/users/95c9fc4c832d4d94b2e949bc92c26967` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:53.554924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c9fc4c832d4d94b2e949bc92c26967)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:53.559125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:53.559262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f87065-5b7c-4ec2-b73d-84cc28a37160 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:53.562883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:53.563792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:53.563792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:53.564577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] PATH_INFO: `/v3/users/6ced3215b54a4850982fcebe3a0b30e1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:53.565300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ced3215b54a4850982fcebe3a0b30e1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:53.567220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:53.775611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c9fc4c832d4d94b2e949bc92c26967'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.790507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c9fc4c832d4d94b2e949bc92c26967'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.792344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ced3215b54a4850982fcebe3a0b30e1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.806077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ced3215b54a4850982fcebe3a0b30e1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.857564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c9fc4c832d4d94b2e949bc92c26967'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.858329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c9fc4c832d4d94b2e949bc92c26967'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.859093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c9fc4c832d4d94b2e949bc92c26967'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.874063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1020/2031] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:53 2022] DELETE /identity/v3/users/95c9fc4c832d4d94b2e949bc92c26967 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:53.874845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:53.876207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:53.943226 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ced3215b54a4850982fcebe3a0b30e1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.944347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ced3215b54a4850982fcebe3a0b30e1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.945500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1ce19fa6-b9d1-497e-a2c5-b67329d9f19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ced3215b54a4850982fcebe3a0b30e1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:53.952436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555df98-ee83-450a-9e76-8eda08c318b5 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:53.957461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:53.958721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:53.959038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:53.959314 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] PATH_INFO: `/v3/users/e2d08b5e5c734b42b6f500bbf22e30a8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:53.961115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d08b5e5c734b42b6f500bbf22e30a8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:53.962199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1012/2032] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:53 2022] DELETE /identity/v3/users/6ced3215b54a4850982fcebe3a0b30e1 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:53.964896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:53.968505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8c87-1f20-40c5-be6e-5dde4a8bc8d3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:53.968836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8c87-1f20-40c5-be6e-5dde4a8bc8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:53.969117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8c87-1f20-40c5-be6e-5dde4a8bc8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:53.991280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f83a8c87-1f20-40c5-be6e-5dde4a8bc8d3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:53.993288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f83a8c87-1f20-40c5-be6e-5dde4a8bc8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:54.074083 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1013/2033] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:54.084372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a8c87-1f20-40c5-be6e-5dde4a8bc8d3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:54.085965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f83a8c87-1f20-40c5-be6e-5dde4a8bc8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:54.155126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a8c87-1f20-40c5-be6e-5dde4a8bc8d3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:54.159117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660e2c2-7a68-4af8-8b02-b6774439cb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:54.159808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660e2c2-7a68-4af8-8b02-b6774439cb9a service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:54.166656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660e2c2-7a68-4af8-8b02-b6774439cb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:54.166656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660e2c2-7a68-4af8-8b02-b6774439cb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:54.171543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660e2c2-7a68-4af8-8b02-b6774439cb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:54.173025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660e2c2-7a68-4af8-8b02-b6774439cb9a service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:54.186240 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1014/2034] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:54.291852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d08b5e5c734b42b6f500bbf22e30a8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:54.304388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d08b5e5c734b42b6f500bbf22e30a8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:54.452389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d08b5e5c734b42b6f500bbf22e30a8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:54.453687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660e2c2-7a68-4af8-8b02-b6774439cb9a service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:54.454127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d08b5e5c734b42b6f500bbf22e30a8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:54.455281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b6ee26d9-38b0-455f-8a2c-88c108a8e1af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d08b5e5c734b42b6f500bbf22e30a8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:54.456512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b660e2c2-7a68-4af8-8b02-b6774439cb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:54.482607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660e2c2-7a68-4af8-8b02-b6774439cb9a service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:54.484535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1021/2035] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:53 2022] DELETE /identity/v3/users/e2d08b5e5c734b42b6f500bbf22e30a8 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:54.544530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:54.601241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:54.602600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:54.603065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:54.603516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] PATH_INFO: `/v3/projects/d7fa8621ffc3402788d523de1a85d68e` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:54.606285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7fa8621ffc3402788d523de1a85d68e)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:54.608582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:54.756213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7fa8621ffc3402788d523de1a85d68e', 'request_id': 'req-95189b85-7146-47e9-8494-e90b4e0eed02'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:54.764041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7fa8621ffc3402788d523de1a85d68e', 'request_id': 'req-95189b85-7146-47e9-8494-e90b4e0eed02'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:54.933332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7fa8621ffc3402788d523de1a85d68e', 'request_id': 'req-95189b85-7146-47e9-8494-e90b4e0eed02'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:54.949206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] The token cache is being invalidate because project d7fa8621ffc3402788d523de1a85d68e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:54.949515 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:54.950306 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:54.955158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1015/2036] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:54 2022] DELETE /identity/v3/projects/d7fa8621ffc3402788d523de1a85d68e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:54.957550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce6bd2-aae8-4220-8c69-c0721843efe3 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:54.958550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce6bd2-aae8-4220-8c69-c0721843efe3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:54.959197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce6bd2-aae8-4220-8c69-c0721843efe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:54.994110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-96ce6bd2-aae8-4220-8c69-c0721843efe3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:54.996356 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-96ce6bd2-aae8-4220-8c69-c0721843efe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:55.040293 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:55.043967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:55.100774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1022/2037] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:55.109309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0de81b-7c81-43b1-b75a-63911e98725b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:55.110062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0de81b-7c81-43b1-b75a-63911e98725b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:55.110356 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0de81b-7c81-43b1-b75a-63911e98725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:55.134568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-7d0de81b-7c81-43b1-b75a-63911e98725b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:55.136338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7d0de81b-7c81-43b1-b75a-63911e98725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:55.150644 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1023/2038] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:55.151863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0de81b-7c81-43b1-b75a-63911e98725b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:55.163682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0de81b-7c81-43b1-b75a-63911e98725b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:55.179364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235998b-d799-4a58-a13d-52e8418694cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:55.180181 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235998b-d799-4a58-a13d-52e8418694cf admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:55.180402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235998b-d799-4a58-a13d-52e8418694cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:55.180703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235998b-d799-4a58-a13d-52e8418694cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:55.181545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235998b-d799-4a58-a13d-52e8418694cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:55.181861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235998b-d799-4a58-a13d-52e8418694cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:55.183634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235998b-d799-4a58-a13d-52e8418694cf admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:55.205430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1024/2039] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:55.210170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235998b-d799-4a58-a13d-52e8418694cf admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:55.216198 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95189b85-7146-47e9-8494-e90b4e0eed02 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:55.221036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:55.221933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:55.222219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:55.222498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] PATH_INFO: `/v3/projects/fe70bbba5f0d4d6ca4776565980ca8fb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:55.223753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe70bbba5f0d4d6ca4776565980ca8fb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:55.225636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235998b-d799-4a58-a13d-52e8418694cf admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:55.225956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:55.231154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67784e8c-4bbb-4de9-a186-6bc80d18ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:55.231870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67784e8c-4bbb-4de9-a186-6bc80d18ab7c admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:55.232221 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67784e8c-4bbb-4de9-a186-6bc80d18ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:55.232659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67784e8c-4bbb-4de9-a186-6bc80d18ab7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:55.233453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67784e8c-4bbb-4de9-a186-6bc80d18ab7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:55.235389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67784e8c-4bbb-4de9-a186-6bc80d18ab7c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:55.252450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:55.364852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1025/2040] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:55 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:55.365930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67784e8c-4bbb-4de9-a186-6bc80d18ab7c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:55.369218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-67784e8c-4bbb-4de9-a186-6bc80d18ab7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:55.382606 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe70bbba5f0d4d6ca4776565980ca8fb', 'request_id': 'req-5006b5db-910d-42a7-87a4-f355c504f2bf'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:55.388661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe70bbba5f0d4d6ca4776565980ca8fb', 'request_id': 'req-5006b5db-910d-42a7-87a4-f355c504f2bf'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:55.455419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67784e8c-4bbb-4de9-a186-6bc80d18ab7c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:55.461363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:55.462225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:55.462507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:55.462806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] PATH_INFO: `/v3/projects/6c7eb7488c4f496baf938a40755726d0` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:55.464008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7eb7488c4f496baf938a40755726d0)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:55.465946 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:55.480398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe70bbba5f0d4d6ca4776565980ca8fb', 'request_id': 'req-5006b5db-910d-42a7-87a4-f355c504f2bf'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:55.494340 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] The token cache is being invalidate because project fe70bbba5f0d4d6ca4776565980ca8fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:55.494766 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:55.495875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:55.497380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1016/2041] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:55 2022] DELETE /identity/v3/projects/fe70bbba5f0d4d6ca4776565980ca8fb => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:55.498311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:55.499749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:55.582940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b5db-910d-42a7-87a4-f355c504f2bf admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:55.589579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fc34f-ba92-4547-90db-431d5d826eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:55.590517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fc34f-ba92-4547-90db-431d5d826eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:55.590802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fc34f-ba92-4547-90db-431d5d826eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:55.591079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fc34f-ba92-4547-90db-431d5d826eaf admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:55.591780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fc34f-ba92-4547-90db-431d5d826eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:55.593744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fc34f-ba92-4547-90db-431d5d826eaf admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:55.625964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7eb7488c4f496baf938a40755726d0', 'request_id': 'req-13b72fa6-8bf4-4814-b935-cc329a22b00e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:55.632544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7eb7488c4f496baf938a40755726d0', 'request_id': 'req-13b72fa6-8bf4-4814-b935-cc329a22b00e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:55.639312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7eb7488c4f496baf938a40755726d0', 'request_id': 'req-13b72fa6-8bf4-4814-b935-cc329a22b00e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:55.795143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] The token cache is being invalidate because project 6c7eb7488c4f496baf938a40755726d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:55.796289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:55.796480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-13b72fa6-8bf4-4814-b935-cc329a22b00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:55.797400 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1017/2042] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:55 2022] POST /identity/v3/users => generated 295 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:55.798640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1026/2043] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:55 2022] DELETE /identity/v3/projects/6c7eb7488c4f496baf938a40755726d0 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:55.798815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fc34f-ba92-4547-90db-431d5d826eaf admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:55.800508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-637fc34f-ba92-4547-90db-431d5d826eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:55.806928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7fa4c-655f-4ef4-9c51-4fc7be185899 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:55.807888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7fa4c-655f-4ef4-9c51-4fc7be185899 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:55.808280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7fa4c-655f-4ef4-9c51-4fc7be185899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:55.820462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fc34f-ba92-4547-90db-431d5d826eaf admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:55.854889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-98f7fa4c-655f-4ef4-9c51-4fc7be185899 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:55.856578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-98f7fa4c-655f-4ef4-9c51-4fc7be185899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:55.895752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:55.896690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:55.896976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:55.898092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] PATH_INFO: `/v3/users/96d5bccfee5542079beef3320a048ba5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:55.900435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d5bccfee5542079beef3320a048ba5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:55.919920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:55.974096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1027/2044] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:55.981349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7fa4c-655f-4ef4-9c51-4fc7be185899 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:55.981349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-98f7fa4c-655f-4ef4-9c51-4fc7be185899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:55.990482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7fa4c-655f-4ef4-9c51-4fc7be185899 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:56.002183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2da65c-096d-4225-b681-e5d98dd001c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:56.009274 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da65c-096d-4225-b681-e5d98dd001c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.009573 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da65c-096d-4225-b681-e5d98dd001c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.009978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da65c-096d-4225-b681-e5d98dd001c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.010844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2da65c-096d-4225-b681-e5d98dd001c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:56.012575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2da65c-096d-4225-b681-e5d98dd001c2 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:56.031543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1028/2045] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:56.036781 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9266bfc-6e7f-4223-94cd-475f11cc46d9 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.036781 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9266bfc-6e7f-4223-94cd-475f11cc46d9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.036781 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9266bfc-6e7f-4223-94cd-475f11cc46d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.061122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a9266bfc-6e7f-4223-94cd-475f11cc46d9 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:56.063547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a9266bfc-6e7f-4223-94cd-475f11cc46d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:56.075096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1029/2046] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:56.076029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9266bfc-6e7f-4223-94cd-475f11cc46d9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:56.077520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a9266bfc-6e7f-4223-94cd-475f11cc46d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:56.168411 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9266bfc-6e7f-4223-94cd-475f11cc46d9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:56.172647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3ced4-6bae-4393-a4fc-b7df1950dbff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:56.173570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ced4-6bae-4393-a4fc-b7df1950dbff service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.174018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ced4-6bae-4393-a4fc-b7df1950dbff service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.180996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ced4-6bae-4393-a4fc-b7df1950dbff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.180996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a8f3ced4-6bae-4393-a4fc-b7df1950dbff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:56.252677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3ced4-6bae-4393-a4fc-b7df1950dbff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:56.254022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3ced4-6bae-4393-a4fc-b7df1950dbff service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:56.259441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d5bccfee5542079beef3320a048ba5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:56.268039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1030/2047] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:56.268755 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3ced4-6bae-4393-a4fc-b7df1950dbff service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:56.281110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3ced4-6bae-4393-a4fc-b7df1950dbff service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:56.287269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beb391-f657-4f9c-b899-a13e1b591799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:56.287611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d5bccfee5542079beef3320a048ba5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:56.288157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beb391-f657-4f9c-b899-a13e1b591799 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.288741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beb391-f657-4f9c-b899-a13e1b591799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.288902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beb391-f657-4f9c-b899-a13e1b591799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.289793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19beb391-f657-4f9c-b899-a13e1b591799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:56.292120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19beb391-f657-4f9c-b899-a13e1b591799 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:56.303632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1031/2048] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:56.304635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beb391-f657-4f9c-b899-a13e1b591799 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:56.320797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beb391-f657-4f9c-b899-a13e1b591799 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:56.325770 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d65221-bfe7-4240-8d8a-253c92805d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:56.326530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d65221-bfe7-4240-8d8a-253c92805d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.327027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d65221-bfe7-4240-8d8a-253c92805d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.327974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d65221-bfe7-4240-8d8a-253c92805d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.328742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d65221-bfe7-4240-8d8a-253c92805d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:56.329061 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d65221-bfe7-4240-8d8a-253c92805d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:56.330671 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d65221-bfe7-4240-8d8a-253c92805d8d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:56.352919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1032/2049] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:56.354043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d65221-bfe7-4240-8d8a-253c92805d8d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:56.364524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d65221-bfe7-4240-8d8a-253c92805d8d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:56.370042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c532859-9b8d-49a4-9442-9dec48c793aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:56.371088 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c532859-9b8d-49a4-9442-9dec48c793aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.371294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c532859-9b8d-49a4-9442-9dec48c793aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.372343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c532859-9b8d-49a4-9442-9dec48c793aa admin admin] PATH_INFO: `/v3/projects/527cbee953434d6188705678df331221/users/20c8185928c149928ab2d89e9433502f/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.391249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c532859-9b8d-49a4-9442-9dec48c793aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=527cbee953434d6188705678df331221, user_id=20c8185928c149928ab2d89e9433502f, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:56.394300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c532859-9b8d-49a4-9442-9dec48c793aa admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:56.400483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d5bccfee5542079beef3320a048ba5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:56.401134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d5bccfee5542079beef3320a048ba5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:56.401751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d5bccfee5542079beef3320a048ba5'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:56.415684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1018/2050] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:55 2022] DELETE /identity/v3/users/96d5bccfee5542079beef3320a048ba5 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:56.416612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:56.417997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:56.503025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1033/2051] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:56 2022] PUT /identity/v3/projects/527cbee953434d6188705678df331221/users/20c8185928c149928ab2d89e9433502f/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:56.527162 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44376fa5-0647-4450-8ed0-f0f06ec1d851 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.527650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44376fa5-0647-4450-8ed0-f0f06ec1d851 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.528337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44376fa5-0647-4450-8ed0-f0f06ec1d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.535246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557802d6-b427-4425-b616-e24f04f7981c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:56.600883 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-44376fa5-0647-4450-8ed0-f0f06ec1d851 None None] MFA Rules not processed for user `20c8185928c149928ab2d89e9433502f`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:56.602225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-44376fa5-0647-4450-8ed0-f0f06ec1d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:56.617995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40d674-2659-4e8a-b751-038b55ea3906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:56.617995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d674-2659-4e8a-b751-038b55ea3906 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.617995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d674-2659-4e8a-b751-038b55ea3906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.617995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d674-2659-4e8a-b751-038b55ea3906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.619698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40d674-2659-4e8a-b751-038b55ea3906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:56.624313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40d674-2659-4e8a-b751-038b55ea3906 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:56.730589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1034/2052] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:56.734477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44376fa5-0647-4450-8ed0-f0f06ec1d851 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:56.737272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-44376fa5-0647-4450-8ed0-f0f06ec1d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:56.759505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44376fa5-0647-4450-8ed0-f0f06ec1d851 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:56.766896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00cea3-46ac-4c5d-b413-7cf565d7a3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:56.767851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00cea3-46ac-4c5d-b413-7cf565d7a3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.769589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00cea3-46ac-4c5d-b413-7cf565d7a3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.770106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00cea3-46ac-4c5d-b413-7cf565d7a3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.770928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00cea3-46ac-4c5d-b413-7cf565d7a3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:56.774141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00cea3-46ac-4c5d-b413-7cf565d7a3b6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:56.779461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1019/2053] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:56 2022] POST /identity/v3/projects => generated 373 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:56.780809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40d674-2659-4e8a-b751-038b55ea3906 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:56.861332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40d674-2659-4e8a-b751-038b55ea3906 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:56.868534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2e629-3911-4f28-8839-d2887eed8de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:56.870978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2e629-3911-4f28-8839-d2887eed8de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.870978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2e629-3911-4f28-8839-d2887eed8de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.870978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2e629-3911-4f28-8839-d2887eed8de6 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.871285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2e629-3911-4f28-8839-d2887eed8de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:56.873631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2e629-3911-4f28-8839-d2887eed8de6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:56.892168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:56.903045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1035/2054] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:56 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:56.904547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00cea3-46ac-4c5d-b413-7cf565d7a3b6 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:56.984795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00cea3-46ac-4c5d-b413-7cf565d7a3b6 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:56.992118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d8ac6-0d24-4d46-94fc-0a3b9301c095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:56.994450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d8ac6-0d24-4d46-94fc-0a3b9301c095 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:56.994450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d8ac6-0d24-4d46-94fc-0a3b9301c095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:56.994450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d8ac6-0d24-4d46-94fc-0a3b9301c095 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:56.994450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d8ac6-0d24-4d46-94fc-0a3b9301c095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:56.996315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d8ac6-0d24-4d46-94fc-0a3b9301c095 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:57.052691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1020/2055] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:56 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:57.057961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2e629-3911-4f28-8839-d2887eed8de6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:57.069233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2e629-3911-4f28-8839-d2887eed8de6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:57.080324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02f6ad-eba2-45af-8d61-30d17d4cf390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:57.081850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f6ad-eba2-45af-8d61-30d17d4cf390 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.082355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f6ad-eba2-45af-8d61-30d17d4cf390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.083098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f6ad-eba2-45af-8d61-30d17d4cf390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.084333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02f6ad-eba2-45af-8d61-30d17d4cf390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:57.086198 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02f6ad-eba2-45af-8d61-30d17d4cf390 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:57.098299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1021/2056] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:57.104357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02f6ad-eba2-45af-8d61-30d17d4cf390 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:57.116783 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02f6ad-eba2-45af-8d61-30d17d4cf390 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:57.134247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe96995-684a-4abd-905a-709f69cfbb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:57.135677 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe96995-684a-4abd-905a-709f69cfbb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.136323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe96995-684a-4abd-905a-709f69cfbb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.136708 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe96995-684a-4abd-905a-709f69cfbb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.137522 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe96995-684a-4abd-905a-709f69cfbb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:57.140180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe96995-684a-4abd-905a-709f69cfbb1b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:57.157211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1022/2057] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:57.158920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1036/2058] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:56 2022] POST /identity/v3/users => generated 301 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:57.200317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe96995-684a-4abd-905a-709f69cfbb1b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:57.207486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d8ac6-0d24-4d46-94fc-0a3b9301c095 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:57.218822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe96995-684a-4abd-905a-709f69cfbb1b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:57.245404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47369bd-ce4c-44df-8273-209dd5f4c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:57.245854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47369bd-ce4c-44df-8273-209dd5f4c12f admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.246136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47369bd-ce4c-44df-8273-209dd5f4c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.246410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47369bd-ce4c-44df-8273-209dd5f4c12f admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.247146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47369bd-ce4c-44df-8273-209dd5f4c12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:57.254159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47369bd-ce4c-44df-8273-209dd5f4c12f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:57.261073 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d8ac6-0d24-4d46-94fc-0a3b9301c095 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:57.268788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2847b9-dfc8-4c17-af3b-9a378e35c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:57.270149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2847b9-dfc8-4c17-af3b-9a378e35c76d admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.270275 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2847b9-dfc8-4c17-af3b-9a378e35c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.270488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2847b9-dfc8-4c17-af3b-9a378e35c76d admin admin] PATH_INFO: `/v3/projects/3b2352c5c11848a7a2d66817baebe808/users/2ab213d4944042199ee9405ed9366c6f/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.275633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1023/2059] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:57.277309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47369bd-ce4c-44df-8273-209dd5f4c12f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:57.279575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a47369bd-ce4c-44df-8273-209dd5f4c12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:57.297854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47369bd-ce4c-44df-8273-209dd5f4c12f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:57.313398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:57.314601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.315083 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.317086 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] PATH_INFO: `/v3/projects/e09172ac151b4d5c84188661c9be291e` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.319034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09172ac151b4d5c84188661c9be291e)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:57.319181 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2847b9-dfc8-4c17-af3b-9a378e35c76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2352c5c11848a7a2d66817baebe808, user_id=2ab213d4944042199ee9405ed9366c6f, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:57.322887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2847b9-dfc8-4c17-af3b-9a378e35c76d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:57.324624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:57.433724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1037/2060] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:57 2022] PUT /identity/v3/projects/3b2352c5c11848a7a2d66817baebe808/users/2ab213d4944042199ee9405ed9366c6f/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:57.435332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2847b9-dfc8-4c17-af3b-9a378e35c76d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:57.458423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:57.484007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09172ac151b4d5c84188661c9be291e', 'request_id': 'req-626ceaf9-c78e-44b4-81e5-8e495dcce18c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:57.496558 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09172ac151b4d5c84188661c9be291e', 'request_id': 'req-626ceaf9-c78e-44b4-81e5-8e495dcce18c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:57.541744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2847b9-dfc8-4c17-af3b-9a378e35c76d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:57.555226 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09172ac151b4d5c84188661c9be291e', 'request_id': 'req-626ceaf9-c78e-44b4-81e5-8e495dcce18c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:57.572303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] The token cache is being invalidate because project e09172ac151b4d5c84188661c9be291e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:40:57.573689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:57.574513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-626ceaf9-c78e-44b4-81e5-8e495dcce18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:57.580428 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1024/2061] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:57 2022] DELETE /identity/v3/projects/e09172ac151b4d5c84188661c9be291e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:57.581939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc74be-3640-4b0b-9bf4-79969b47d3ff None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.582228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc74be-3640-4b0b-9bf4-79969b47d3ff None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.582503 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc74be-3640-4b0b-9bf4-79969b47d3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.602311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d7fc74be-3640-4b0b-9bf4-79969b47d3ff None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:57.603545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d7fc74be-3640-4b0b-9bf4-79969b47d3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:57.617102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490021f-f9de-4e39-b5ed-573dcf01710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:57.619078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490021f-f9de-4e39-b5ed-573dcf01710b admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.619564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490021f-f9de-4e39-b5ed-573dcf01710b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.620058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490021f-f9de-4e39-b5ed-573dcf01710b admin admin] PATH_INFO: `/v3/projects/d9a49a828517454e8a2623ecba13ee87/users/c46388c2bd1c453f9360b9419e3b4f28/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.640993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490021f-f9de-4e39-b5ed-573dcf01710b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a49a828517454e8a2623ecba13ee87, user_id=c46388c2bd1c453f9360b9419e3b4f28, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:57.643994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490021f-f9de-4e39-b5ed-573dcf01710b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:57.708200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1025/2062] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:57.709541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c6ec-9655-4b4a-8530-0bcf594a75cf None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.709845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c6ec-9655-4b4a-8530-0bcf594a75cf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.710122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c6ec-9655-4b4a-8530-0bcf594a75cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.730701 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0851c6ec-9655-4b4a-8530-0bcf594a75cf None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:57.731844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0851c6ec-9655-4b4a-8530-0bcf594a75cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:57.739772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1026/2063] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:57.740751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c6ec-9655-4b4a-8530-0bcf594a75cf None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:57.743062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0851c6ec-9655-4b4a-8530-0bcf594a75cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:57.753106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1038/2064] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:57 2022] PUT /identity/v3/projects/d9a49a828517454e8a2623ecba13ee87/users/c46388c2bd1c453f9360b9419e3b4f28/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:57.758962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e020-4dcd-4013-8f48-a2a651e19d43 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.758962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e020-4dcd-4013-8f48-a2a651e19d43 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.758962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e020-4dcd-4013-8f48-a2a651e19d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.778677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-f987e020-4dcd-4013-8f48-a2a651e19d43 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:57.780243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f987e020-4dcd-4013-8f48-a2a651e19d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:57.829343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c6ec-9655-4b4a-8530-0bcf594a75cf None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:57.953077 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1039/2065] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:57.954071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987e020-4dcd-4013-8f48-a2a651e19d43 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:57.954822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d6ad7-4d57-4dc6-abd5-b3e7eb9f66da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:57.955405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f987e020-4dcd-4013-8f48-a2a651e19d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:57.955943 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6ad7-4d57-4dc6-abd5-b3e7eb9f66da service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.956729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6ad7-4d57-4dc6-abd5-b3e7eb9f66da service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.957373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6ad7-4d57-4dc6-abd5-b3e7eb9f66da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.977700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d6ad7-4d57-4dc6-abd5-b3e7eb9f66da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:57.979178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d6ad7-4d57-4dc6-abd5-b3e7eb9f66da service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:57.985520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987e020-4dcd-4013-8f48-a2a651e19d43 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:57.991284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eeb444-0084-4211-9155-1f499b948240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:57.992193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eeb444-0084-4211-9155-1f499b948240 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:57.992501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eeb444-0084-4211-9155-1f499b948240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:57.992766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eeb444-0084-4211-9155-1f499b948240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:57.995151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eeb444-0084-4211-9155-1f499b948240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:57.995151 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eeb444-0084-4211-9155-1f499b948240 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:58.002176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1027/2066] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:58.003055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d6ad7-4d57-4dc6-abd5-b3e7eb9f66da service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:58.011742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1040/2067] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:58.013514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eeb444-0084-4211-9155-1f499b948240 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:58.015007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d6ad7-4d57-4dc6-abd5-b3e7eb9f66da service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:58.021122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f715d0-f913-4688-8e1d-9cac3591cb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:58.028562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f715d0-f913-4688-8e1d-9cac3591cb3f admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.028562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f715d0-f913-4688-8e1d-9cac3591cb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.028562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f715d0-f913-4688-8e1d-9cac3591cb3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.028562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f715d0-f913-4688-8e1d-9cac3591cb3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:40:58.028562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f715d0-f913-4688-8e1d-9cac3591cb3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:58.028562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f715d0-f913-4688-8e1d-9cac3591cb3f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:58.048067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eeb444-0084-4211-9155-1f499b948240 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:58.051938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1028/2068] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:40:58.053356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f715d0-f913-4688-8e1d-9cac3591cb3f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:58.054194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29aebfb-f608-4ea8-b10b-58cc190a467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:58.057116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aebfb-f608-4ea8-b10b-58cc190a467f admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.057116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aebfb-f608-4ea8-b10b-58cc190a467f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.057116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aebfb-f608-4ea8-b10b-58cc190a467f admin admin] PATH_INFO: `/v3/projects/d9a49a828517454e8a2623ecba13ee87/users/c46388c2bd1c453f9360b9419e3b4f28/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.059174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29aebfb-f608-4ea8-b10b-58cc190a467f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a49a828517454e8a2623ecba13ee87, user_id=c46388c2bd1c453f9360b9419e3b4f28, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:58.063547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29aebfb-f608-4ea8-b10b-58cc190a467f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:58.073900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f715d0-f913-4688-8e1d-9cac3591cb3f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:58.088049 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1041/2069] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:58 2022] PUT /identity/v3/projects/d9a49a828517454e8a2623ecba13ee87/users/c46388c2bd1c453f9360b9419e3b4f28/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:58.105086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b88f0-179c-41b7-a4e4-4e63d8855131 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.105452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b88f0-179c-41b7-a4e4-4e63d8855131 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.105807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b88f0-179c-41b7-a4e4-4e63d8855131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.148626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3c1b88f0-179c-41b7-a4e4-4e63d8855131 None None] MFA Rules not processed for user `c46388c2bd1c453f9360b9419e3b4f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:58.150227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3c1b88f0-179c-41b7-a4e4-4e63d8855131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:58.172729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714495e-7bb9-4d41-bdc0-3cff8be98d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:58.173345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714495e-7bb9-4d41-bdc0-3cff8be98d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.173773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714495e-7bb9-4d41-bdc0-3cff8be98d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.174116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714495e-7bb9-4d41-bdc0-3cff8be98d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.175190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714495e-7bb9-4d41-bdc0-3cff8be98d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:58.178350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714495e-7bb9-4d41-bdc0-3cff8be98d00 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:58.212473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:58.238395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1042/2070] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:40:58.250268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b88f0-179c-41b7-a4e4-4e63d8855131 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:58.252047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3c1b88f0-179c-41b7-a4e4-4e63d8855131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:58.313264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b88f0-179c-41b7-a4e4-4e63d8855131 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:58.316914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f1420-6fa8-46e9-bd34-1dfb09b50c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:58.317566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f1420-6fa8-46e9-bd34-1dfb09b50c6f service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.317896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f1420-6fa8-46e9-bd34-1dfb09b50c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.318139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f1420-6fa8-46e9-bd34-1dfb09b50c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.327371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f1420-6fa8-46e9-bd34-1dfb09b50c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:58.328896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f1420-6fa8-46e9-bd34-1dfb09b50c6f service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:58.340300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1043/2071] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:58.378773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1029/2072] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:58 2022] POST /identity/v3/projects => generated 375 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:58.384007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f1420-6fa8-46e9-bd34-1dfb09b50c6f service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:58.395773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f1420-6fa8-46e9-bd34-1dfb09b50c6f service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:58.440634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:58.513246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5332a-4f0e-4dd7-9045-cdce21f505e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:58.515331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5332a-4f0e-4dd7-9045-cdce21f505e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.516040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5332a-4f0e-4dd7-9045-cdce21f505e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.516940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5332a-4f0e-4dd7-9045-cdce21f505e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.519092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5332a-4f0e-4dd7-9045-cdce21f505e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:58.523853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5332a-4f0e-4dd7-9045-cdce21f505e1 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:58.524864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714495e-7bb9-4d41-bdc0-3cff8be98d00 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:58.540869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714495e-7bb9-4d41-bdc0-3cff8be98d00 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:58.547217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:58.549168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.549168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.558813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] PATH_INFO: `/v3/users/20c8185928c149928ab2d89e9433502f` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.558813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c8185928c149928ab2d89e9433502f)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:58.558813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:58.647672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1044/2073] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:58 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:58.649328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5332a-4f0e-4dd7-9045-cdce21f505e1 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:58.667211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5332a-4f0e-4dd7-9045-cdce21f505e1 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:58.672382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f4070-1ef3-41fb-830b-60d896256cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:58.673080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f4070-1ef3-41fb-830b-60d896256cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.673373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f4070-1ef3-41fb-830b-60d896256cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.673650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f4070-1ef3-41fb-830b-60d896256cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.674396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f4070-1ef3-41fb-830b-60d896256cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:58.676386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f4070-1ef3-41fb-830b-60d896256cf1 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:58.688859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1045/2074] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:40:58.692994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f4070-1ef3-41fb-830b-60d896256cf1 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:58.706270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f4070-1ef3-41fb-830b-60d896256cf1 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:58.713189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444b340-7846-4638-97ed-0346037cc2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:58.714012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444b340-7846-4638-97ed-0346037cc2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.714353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444b340-7846-4638-97ed-0346037cc2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.714700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444b340-7846-4638-97ed-0346037cc2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.715549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444b340-7846-4638-97ed-0346037cc2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:58.717351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444b340-7846-4638-97ed-0346037cc2e0 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:58.731241 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1046/2075] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:58.736289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444b340-7846-4638-97ed-0346037cc2e0 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:58.748163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444b340-7846-4638-97ed-0346037cc2e0 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:58.753229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dcfbd-57a6-4bb6-9767-98d20369abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:58.754253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dcfbd-57a6-4bb6-9767-98d20369abb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.754637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dcfbd-57a6-4bb6-9767-98d20369abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.754975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dcfbd-57a6-4bb6-9767-98d20369abb6 admin admin] PATH_INFO: `/v3/projects/190eb71058004be7a3bfcfc08259126e/users/2532d598769d4dbe89de4ddf3924363a/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.787082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dcfbd-57a6-4bb6-9767-98d20369abb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190eb71058004be7a3bfcfc08259126e, user_id=2532d598769d4dbe89de4ddf3924363a, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:58.790078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dcfbd-57a6-4bb6-9767-98d20369abb6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:58.807112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c8185928c149928ab2d89e9433502f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:58.824720 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c8185928c149928ab2d89e9433502f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:58.943077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c8185928c149928ab2d89e9433502f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:58.944970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c8185928c149928ab2d89e9433502f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:58.946676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-76922d37-0da6-4b7d-882b-079336709a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c8185928c149928ab2d89e9433502f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:40:58.956631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1047/2076] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:58 2022] PUT /identity/v3/projects/190eb71058004be7a3bfcfc08259126e/users/2532d598769d4dbe89de4ddf3924363a/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:40:58.963366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1030/2077] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:40:58 2022] DELETE /identity/v3/users/20c8185928c149928ab2d89e9433502f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:58.970664 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eff27-256d-449f-997e-70ba6d7e741a None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.971438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8995bd-1e0f-4797-be3e-84e99bad9036 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:58.971599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eff27-256d-449f-997e-70ba6d7e741a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.971904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8995bd-1e0f-4797-be3e-84e99bad9036 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:58.972005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eff27-256d-449f-997e-70ba6d7e741a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:58.972239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8995bd-1e0f-4797-be3e-84e99bad9036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:59.002010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5a8995bd-1e0f-4797-be3e-84e99bad9036 None None] MFA Rules not processed for user `2532d598769d4dbe89de4ddf3924363a`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:59.003816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5a8995bd-1e0f-4797-be3e-84e99bad9036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:59.008233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-566eff27-256d-449f-997e-70ba6d7e741a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:40:59.010167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-566eff27-256d-449f-997e-70ba6d7e741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:59.083206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1031/2078] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:59.088359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8995bd-1e0f-4797-be3e-84e99bad9036 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:59.090136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5a8995bd-1e0f-4797-be3e-84e99bad9036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:59.111575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1048/2079] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:40:59.122832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eff27-256d-449f-997e-70ba6d7e741a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:59.124414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-566eff27-256d-449f-997e-70ba6d7e741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:59.183583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8995bd-1e0f-4797-be3e-84e99bad9036 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:59.189228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bff7a-f9c1-48de-9374-b6a635752d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:59.190003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bff7a-f9c1-48de-9374-b6a635752d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:59.190404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bff7a-f9c1-48de-9374-b6a635752d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:59.190685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bff7a-f9c1-48de-9374-b6a635752d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:59.191392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bff7a-f9c1-48de-9374-b6a635752d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:59.193452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bff7a-f9c1-48de-9374-b6a635752d76 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:59.201113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eff27-256d-449f-997e-70ba6d7e741a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:59.204918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ddb42-0ec1-44db-bf60-2eb86582ccb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:59.210416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ddb42-0ec1-44db-bf60-2eb86582ccb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:59.210416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ddb42-0ec1-44db-bf60-2eb86582ccb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:59.210416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ddb42-0ec1-44db-bf60-2eb86582ccb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:59.216876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ddb42-0ec1-44db-bf60-2eb86582ccb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:59.218469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ddb42-0ec1-44db-bf60-2eb86582ccb8 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:59.229240 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1049/2080] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:40:59.321857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1032/2081] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:40:59 2022] POST /identity/v3/projects => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:40:59.323260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ddb42-0ec1-44db-bf60-2eb86582ccb8 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:59.336250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ddb42-0ec1-44db-bf60-2eb86582ccb8 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:59.399324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025e6ab-eb85-4850-baeb-65bf07acc63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:59.400681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025e6ab-eb85-4850-baeb-65bf07acc63c admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:59.401276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025e6ab-eb85-4850-baeb-65bf07acc63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:59.401763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025e6ab-eb85-4850-baeb-65bf07acc63c admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:59.402679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025e6ab-eb85-4850-baeb-65bf07acc63c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:59.405797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025e6ab-eb85-4850-baeb-65bf07acc63c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:59.524890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1050/2082] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:40:59 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:40:59.535997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:59.540111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bff7a-f9c1-48de-9374-b6a635752d76 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:59.565442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bff7a-f9c1-48de-9374-b6a635752d76 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:59.597411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962606df-b9c4-404e-bdf6-dc449ec7db56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:59.598181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962606df-b9c4-404e-bdf6-dc449ec7db56 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:59.598507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962606df-b9c4-404e-bdf6-dc449ec7db56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:59.599701 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962606df-b9c4-404e-bdf6-dc449ec7db56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:59.601693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962606df-b9c4-404e-bdf6-dc449ec7db56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:59.604232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962606df-b9c4-404e-bdf6-dc449ec7db56 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:59.625058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1033/2083] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:40:59.627344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025e6ab-eb85-4850-baeb-65bf07acc63c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:59.650004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025e6ab-eb85-4850-baeb-65bf07acc63c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:59.656917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e043-70e7-4711-a51c-aa4a11d7f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:59.657905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e043-70e7-4711-a51c-aa4a11d7f2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:59.658268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e043-70e7-4711-a51c-aa4a11d7f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:59.658670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e043-70e7-4711-a51c-aa4a11d7f2ac admin admin] PATH_INFO: `/v3/projects/f570b68a58da48a3ad2d2562e20326ad/users/195237c2a601453c81454f4ae26e42eb/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:59.685598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8e043-70e7-4711-a51c-aa4a11d7f2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f570b68a58da48a3ad2d2562e20326ad, user_id=195237c2a601453c81454f4ae26e42eb, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:59.688810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8e043-70e7-4711-a51c-aa4a11d7f2ac admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:59.784380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:59.785760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962606df-b9c4-404e-bdf6-dc449ec7db56 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:59.788303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-962606df-b9c4-404e-bdf6-dc449ec7db56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:40:59.814023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1051/2084] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:40:59 2022] PUT /identity/v3/projects/f570b68a58da48a3ad2d2562e20326ad/users/195237c2a601453c81454f4ae26e42eb/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:40:59.821680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962606df-b9c4-404e-bdf6-dc449ec7db56 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:40:59.822809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e043-70e7-4711-a51c-aa4a11d7f2ac admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:40:59.913535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:40:59.915931 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:40:59.916585 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:40:59.917187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] PATH_INFO: `/v3/projects/527cbee953434d6188705678df331221` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:40:59.919533 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=527cbee953434d6188705678df331221)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:40:59.922110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:40:59.990351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e043-70e7-4711-a51c-aa4a11d7f2ac admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:00.003933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2664380-d34b-47a8-869b-2a9a598b1aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:00.005192 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2664380-d34b-47a8-869b-2a9a598b1aaf admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:00.012629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2664380-d34b-47a8-869b-2a9a598b1aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:00.012629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2664380-d34b-47a8-869b-2a9a598b1aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:00.012629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2664380-d34b-47a8-869b-2a9a598b1aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:00.012629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2664380-d34b-47a8-869b-2a9a598b1aaf admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:00.033434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1052/2085] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:41:00.037704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2664380-d34b-47a8-869b-2a9a598b1aaf admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:00.055174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2664380-d34b-47a8-869b-2a9a598b1aaf admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:00.064322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3b911-f367-4925-877d-ad67f71a6f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:00.065986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3b911-f367-4925-877d-ad67f71a6f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:00.066270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3b911-f367-4925-877d-ad67f71a6f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:00.066620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3b911-f367-4925-877d-ad67f71a6f91 admin admin] PATH_INFO: `/v3/projects/f570b68a58da48a3ad2d2562e20326ad/users/195237c2a601453c81454f4ae26e42eb/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:00.071354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3b911-f367-4925-877d-ad67f71a6f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f570b68a58da48a3ad2d2562e20326ad, user_id=195237c2a601453c81454f4ae26e42eb, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:00.076480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3b911-f367-4925-877d-ad67f71a6f91 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:00.088652 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527cbee953434d6188705678df331221', 'request_id': 'req-46c71811-eb22-413d-96ed-be7e8994c3cb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:00.110351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1053/2086] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:00 2022] PUT /identity/v3/projects/f570b68a58da48a3ad2d2562e20326ad/users/195237c2a601453c81454f4ae26e42eb/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:41:00.112835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fa894-cea1-4917-9708-1b9be9c02361 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:00.113647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fa894-cea1-4917-9708-1b9be9c02361 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:00.114220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fa894-cea1-4917-9708-1b9be9c02361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:00.146153 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527cbee953434d6188705678df331221', 'request_id': 'req-46c71811-eb22-413d-96ed-be7e8994c3cb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:00.161978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-790fa894-cea1-4917-9708-1b9be9c02361 None None] MFA Rules not processed for user `195237c2a601453c81454f4ae26e42eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:00.165131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-790fa894-cea1-4917-9708-1b9be9c02361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:00.263237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527cbee953434d6188705678df331221', 'request_id': 'req-46c71811-eb22-413d-96ed-be7e8994c3cb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:00.281847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] The token cache is being invalidate because project 527cbee953434d6188705678df331221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:00.282402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:00.283605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:00.286748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1034/2087] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:40:59 2022] DELETE /identity/v3/projects/527cbee953434d6188705678df331221 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:41:00.291436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:00.294161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:00.308439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1054/2088] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:00.321972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fa894-cea1-4917-9708-1b9be9c02361 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:00.324017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-790fa894-cea1-4917-9708-1b9be9c02361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:00.413422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c71811-eb22-413d-96ed-be7e8994c3cb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:00.457434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fa894-cea1-4917-9708-1b9be9c02361 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:00.466179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dd8a5-5bfe-4782-bee7-bb01670120d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:00.468989 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd8a5-5bfe-4782-bee7-bb01670120d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:00.470251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd8a5-5bfe-4782-bee7-bb01670120d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:00.471021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd8a5-5bfe-4782-bee7-bb01670120d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:00.482852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-674dd8a5-5bfe-4782-bee7-bb01670120d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:00.515253 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:00.516056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:00.517603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:00.517603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] PATH_INFO: `/v3/users/c46388c2bd1c453f9360b9419e3b4f28` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:00.521864 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46388c2bd1c453f9360b9419e3b4f28)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:00.525138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:00.598078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dd8a5-5bfe-4782-bee7-bb01670120d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:00.601121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dd8a5-5bfe-4782-bee7-bb01670120d8 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:00.624887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1055/2089] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:41:00.664088 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756149e4-460e-46cf-ad00-495498723acd None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:00.664406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756149e4-460e-46cf-ad00-495498723acd None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:00.664816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756149e4-460e-46cf-ad00-495498723acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:00.705641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-756149e4-460e-46cf-ad00-495498723acd None None] MFA Rules not processed for user `2ab213d4944042199ee9405ed9366c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:00.708689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-756149e4-460e-46cf-ad00-495498723acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:00.742595 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:00.770371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46388c2bd1c453f9360b9419e3b4f28'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:00.795131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46388c2bd1c453f9360b9419e3b4f28'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:00.833502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1056/2090] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:00.834913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756149e4-460e-46cf-ad00-495498723acd None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:00.836839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-756149e4-460e-46cf-ad00-495498723acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:00.854897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756149e4-460e-46cf-ad00-495498723acd None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:00.857555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46388c2bd1c453f9360b9419e3b4f28'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:00.862681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46388c2bd1c453f9360b9419e3b4f28'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:00.862681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46388c2bd1c453f9360b9419e3b4f28'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:00.879182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142d831-366c-4509-b82f-086774694958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:00.880163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142d831-366c-4509-b82f-086774694958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:00.880743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142d831-366c-4509-b82f-086774694958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:00.880881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1035/2091] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:00 2022] DELETE /identity/v3/users/c46388c2bd1c453f9360b9419e3b4f28 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:00.880977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142d831-366c-4509-b82f-086774694958 admin admin] PATH_INFO: `/v3/users/28c031d2975a45beba19a6dbfaa691c6` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:00.883533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142d831-366c-4509-b82f-086774694958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c031d2975a45beba19a6dbfaa691c6)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:00.885484 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:00.886911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:00.889803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142d831-366c-4509-b82f-086774694958 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:00.980636 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d8adf-d99d-4132-9eeb-abbd05b51787 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:00.984565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c59ad-d297-4453-b949-a1054d3d8f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:00.985331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c59ad-d297-4453-b949-a1054d3d8f59 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:00.985686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c59ad-d297-4453-b949-a1054d3d8f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:00.986090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c59ad-d297-4453-b949-a1054d3d8f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:00.988185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4f4c59ad-d297-4453-b949-a1054d3d8f59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:01.060201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c59ad-d297-4453-b949-a1054d3d8f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:01.061752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c59ad-d297-4453-b949-a1054d3d8f59 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:01.071753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1036/2092] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:01.154170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:01.170597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3142d831-366c-4509-b82f-086774694958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c031d2975a45beba19a6dbfaa691c6'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:01.191383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3142d831-366c-4509-b82f-086774694958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c031d2975a45beba19a6dbfaa691c6'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:01.352409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3142d831-366c-4509-b82f-086774694958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c031d2975a45beba19a6dbfaa691c6'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:01.352409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3142d831-366c-4509-b82f-086774694958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c031d2975a45beba19a6dbfaa691c6'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:01.352409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3142d831-366c-4509-b82f-086774694958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c031d2975a45beba19a6dbfaa691c6'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:01.371100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1057/2093] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:00 2022] DELETE /identity/v3/users/28c031d2975a45beba19a6dbfaa691c6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:01.665128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c59ad-d297-4453-b949-a1054d3d8f59 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:01.666592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4f4c59ad-d297-4453-b949-a1054d3d8f59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:01.710684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142d831-366c-4509-b82f-086774694958 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:01.712726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3142d831-366c-4509-b82f-086774694958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:01.758838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c59ad-d297-4453-b949-a1054d3d8f59 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:01.815523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142d831-366c-4509-b82f-086774694958 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:01.821124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:01.821937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:01.822079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:01.822886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:01.823030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:01.823166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] PATH_INFO: `/v3/projects/41640d5ecd5a48bf999ba0b8a57284b3` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:01.823331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:01.823665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] PATH_INFO: `/v3/projects/d9a49a828517454e8a2623ecba13ee87` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:01.824716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] RBAC: Authorizing `identity:delete_project(project_id=41640d5ecd5a48bf999ba0b8a57284b3)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:01.824882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a49a828517454e8a2623ecba13ee87)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:01.826719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:01.826837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:01.956933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41640d5ecd5a48bf999ba0b8a57284b3', 'request_id': 'req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:01.964613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41640d5ecd5a48bf999ba0b8a57284b3', 'request_id': 'req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:01.968703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a49a828517454e8a2623ecba13ee87', 'request_id': 'req-6520e9e5-7a51-4072-b18b-f931f398b743'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:01.977772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41640d5ecd5a48bf999ba0b8a57284b3', 'request_id': 'req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:01.979609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a49a828517454e8a2623ecba13ee87', 'request_id': 'req-6520e9e5-7a51-4072-b18b-f931f398b743'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:02.093316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] The token cache is being invalidate because project 41640d5ecd5a48bf999ba0b8a57284b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:02.093620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:02.094724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-48d0932e-2ee0-4471-b0dc-f9fb77f8b56a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:02.099464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1058/2094] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:01 2022] DELETE /identity/v3/projects/41640d5ecd5a48bf999ba0b8a57284b3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:02.102150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a019-2126-4bf4-8f8f-1cda45febcd9 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.102438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a019-2126-4bf4-8f8f-1cda45febcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.102819 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a019-2126-4bf4-8f8f-1cda45febcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.122688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-dcd8a019-2126-4bf4-8f8f-1cda45febcd9 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:02.123898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-dcd8a019-2126-4bf4-8f8f-1cda45febcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:02.137233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a49a828517454e8a2623ecba13ee87', 'request_id': 'req-6520e9e5-7a51-4072-b18b-f931f398b743'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:02.150291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] The token cache is being invalidate because project d9a49a828517454e8a2623ecba13ee87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:02.150508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:02.151371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6520e9e5-7a51-4072-b18b-f931f398b743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:02.153177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1037/2095] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:01 2022] DELETE /identity/v3/projects/d9a49a828517454e8a2623ecba13ee87 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:02.157845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b086a-d045-4986-a797-8d58fbe8c737 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.158139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b086a-d045-4986-a797-8d58fbe8c737 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.158422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b086a-d045-4986-a797-8d58fbe8c737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.179457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a45b086a-d045-4986-a797-8d58fbe8c737 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:02.180826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a45b086a-d045-4986-a797-8d58fbe8c737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:02.204464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1059/2096] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:02.213989 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618aa0-5a44-48d9-8362-f9ada4cc1d5e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.214307 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618aa0-5a44-48d9-8362-f9ada4cc1d5e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.214656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618aa0-5a44-48d9-8362-f9ada4cc1d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.236730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-8e618aa0-5a44-48d9-8362-f9ada4cc1d5e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:02.237953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8e618aa0-5a44-48d9-8362-f9ada4cc1d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:02.247134 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1060/2097] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:02.251636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618aa0-5a44-48d9-8362-f9ada4cc1d5e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.259227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1038/2098] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:02.261427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c773-aed7-44d2-a537-8c3be3d51982 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.261748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c773-aed7-44d2-a537-8c3be3d51982 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.261880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618aa0-5a44-48d9-8362-f9ada4cc1d5e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.262054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c773-aed7-44d2-a537-8c3be3d51982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.277483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad4bba-f236-441f-a49e-3ceb058fcb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.277483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4bba-f236-441f-a49e-3ceb058fcb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.277483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4bba-f236-441f-a49e-3ceb058fcb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.277483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4bba-f236-441f-a49e-3ceb058fcb4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.277798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad4bba-f236-441f-a49e-3ceb058fcb4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:41:02.277798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad4bba-f236-441f-a49e-3ceb058fcb4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.277798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad4bba-f236-441f-a49e-3ceb058fcb4d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.285267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0605c773-aed7-44d2-a537-8c3be3d51982 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:02.286491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1061/2099] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:41:02.286811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0605c773-aed7-44d2-a537-8c3be3d51982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:02.291560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad4bba-f236-441f-a49e-3ceb058fcb4d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.297622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1039/2100] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:02.302313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c773-aed7-44d2-a537-8c3be3d51982 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.309409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad4bba-f236-441f-a49e-3ceb058fcb4d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.311747 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c773-aed7-44d2-a537-8c3be3d51982 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.314823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b10abb-198d-4d30-8509-1897c9653ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.315873 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10abb-198d-4d30-8509-1897c9653ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.316271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10abb-198d-4d30-8509-1897c9653ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.316621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10abb-198d-4d30-8509-1897c9653ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.317427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bcf00-1ac6-4c25-8ae6-5cc9d0c74e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.317578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b10abb-198d-4d30-8509-1897c9653ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.317673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bcf00-1ac6-4c25-8ae6-5cc9d0c74e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.317927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bcf00-1ac6-4c25-8ae6-5cc9d0c74e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.318267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bcf00-1ac6-4c25-8ae6-5cc9d0c74e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.319127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bcf00-1ac6-4c25-8ae6-5cc9d0c74e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:41:02.319595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bcf00-1ac6-4c25-8ae6-5cc9d0c74e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.320296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b10abb-198d-4d30-8509-1897c9653ecc admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.321444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bcf00-1ac6-4c25-8ae6-5cc9d0c74e39 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.338322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1040/2101] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:41:02.339512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bcf00-1ac6-4c25-8ae6-5cc9d0c74e39 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.349779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bcf00-1ac6-4c25-8ae6-5cc9d0c74e39 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.355010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a72a0-982f-4440-9167-a6615e4cb3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.355648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a72a0-982f-4440-9167-a6615e4cb3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.355933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a72a0-982f-4440-9167-a6615e4cb3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.356242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a72a0-982f-4440-9167-a6615e4cb3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.356919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a72a0-982f-4440-9167-a6615e4cb3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.358936 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a72a0-982f-4440-9167-a6615e4cb3e7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.419473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1062/2102] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:02 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:02.423961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b10abb-198d-4d30-8509-1897c9653ecc admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.485893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b10abb-198d-4d30-8509-1897c9653ecc admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.490713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790b9f9-7155-469b-94b7-0520f230d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.491398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790b9f9-7155-469b-94b7-0520f230d79b admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.491690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790b9f9-7155-469b-94b7-0520f230d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.491970 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790b9f9-7155-469b-94b7-0520f230d79b admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.492691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790b9f9-7155-469b-94b7-0520f230d79b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.494607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790b9f9-7155-469b-94b7-0520f230d79b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.525677 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1041/2103] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:02 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:41:02.529535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a72a0-982f-4440-9167-a6615e4cb3e7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.590537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a72a0-982f-4440-9167-a6615e4cb3e7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.595334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060ce07-f0ea-4b09-a99d-089f07a463a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.596015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060ce07-f0ea-4b09-a99d-089f07a463a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.596349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060ce07-f0ea-4b09-a99d-089f07a463a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.596628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060ce07-f0ea-4b09-a99d-089f07a463a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.597314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060ce07-f0ea-4b09-a99d-089f07a463a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.599230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060ce07-f0ea-4b09-a99d-089f07a463a5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.646993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1063/2104] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:02 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:41:02.652195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790b9f9-7155-469b-94b7-0520f230d79b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.662766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790b9f9-7155-469b-94b7-0520f230d79b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.667963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc3b1a-5cae-4dcb-84d4-1b0e98d112be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.668542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc3b1a-5cae-4dcb-84d4-1b0e98d112be admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.668929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc3b1a-5cae-4dcb-84d4-1b0e98d112be admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.669085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc3b1a-5cae-4dcb-84d4-1b0e98d112be admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.669811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc3b1a-5cae-4dcb-84d4-1b0e98d112be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.671395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc3b1a-5cae-4dcb-84d4-1b0e98d112be admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.685172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1064/2105] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:41:02.686068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc3b1a-5cae-4dcb-84d4-1b0e98d112be admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.704403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1042/2106] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:02 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:41:02.704553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc3b1a-5cae-4dcb-84d4-1b0e98d112be admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.704553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130c682-a174-4891-b2f9-fb0c2886a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.704553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130c682-a174-4891-b2f9-fb0c2886a105 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.704553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130c682-a174-4891-b2f9-fb0c2886a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.704864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130c682-a174-4891-b2f9-fb0c2886a105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.704864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130c682-a174-4891-b2f9-fb0c2886a105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.704864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130c682-a174-4891-b2f9-fb0c2886a105 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.706099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060ce07-f0ea-4b09-a99d-089f07a463a5 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.718130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1065/2107] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:02.722006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130c682-a174-4891-b2f9-fb0c2886a105 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.730317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060ce07-f0ea-4b09-a99d-089f07a463a5 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.734869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130c682-a174-4891-b2f9-fb0c2886a105 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.742494 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317024b-4b47-4901-b2b6-0a7edac2d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.742494 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317024b-4b47-4901-b2b6-0a7edac2d0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.742494 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317024b-4b47-4901-b2b6-0a7edac2d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.742494 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317024b-4b47-4901-b2b6-0a7edac2d0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.742843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317024b-4b47-4901-b2b6-0a7edac2d0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.742924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a2d46-26f1-4cee-9ba8-ae07569eeb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.742924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a2d46-26f1-4cee-9ba8-ae07569eeb95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.742924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a2d46-26f1-4cee-9ba8-ae07569eeb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.742924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a2d46-26f1-4cee-9ba8-ae07569eeb95 admin admin] PATH_INFO: `/v3/projects/54ac4eb0aec24c37b29940083d7f8084/users/b2938245f14c41c0920259c87632da22/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.743215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317024b-4b47-4901-b2b6-0a7edac2d0f6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.755390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1043/2108] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:02.760501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317024b-4b47-4901-b2b6-0a7edac2d0f6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.761627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a2d46-26f1-4cee-9ba8-ae07569eeb95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ac4eb0aec24c37b29940083d7f8084, user_id=b2938245f14c41c0920259c87632da22, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.764817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a2d46-26f1-4cee-9ba8-ae07569eeb95 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.772983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317024b-4b47-4901-b2b6-0a7edac2d0f6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.777642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f44ce-7012-41cc-9be8-f30f56048943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.778307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f44ce-7012-41cc-9be8-f30f56048943 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.778588 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f44ce-7012-41cc-9be8-f30f56048943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.778862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f44ce-7012-41cc-9be8-f30f56048943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.779579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f44ce-7012-41cc-9be8-f30f56048943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.781198 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f44ce-7012-41cc-9be8-f30f56048943 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.789784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:02.792829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1044/2109] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:02.796979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f44ce-7012-41cc-9be8-f30f56048943 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:02.808496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f44ce-7012-41cc-9be8-f30f56048943 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:02.817054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eff6c-d2c6-4cfa-a181-d80411f6dcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:02.818457 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eff6c-d2c6-4cfa-a181-d80411f6dcdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.818740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eff6c-d2c6-4cfa-a181-d80411f6dcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.820021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eff6c-d2c6-4cfa-a181-d80411f6dcdc admin admin] PATH_INFO: `/v3/projects/292b2a36eb624924ae07c72f1d1fba6c/users/d0440e4ae28f446e8b98bea73a4adc20/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.859348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eff6c-d2c6-4cfa-a181-d80411f6dcdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=292b2a36eb624924ae07c72f1d1fba6c, user_id=d0440e4ae28f446e8b98bea73a4adc20, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:02.859348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eff6c-d2c6-4cfa-a181-d80411f6dcdc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:02.866614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1066/2110] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:02 2022] PUT /identity/v3/projects/54ac4eb0aec24c37b29940083d7f8084/users/b2938245f14c41c0920259c87632da22/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:41:02.877545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9a471-131b-4fee-af7a-2283ec911493 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:02.877922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9a471-131b-4fee-af7a-2283ec911493 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:02.878324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9a471-131b-4fee-af7a-2283ec911493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:02.908096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4bd9a471-131b-4fee-af7a-2283ec911493 None None] MFA Rules not processed for user `b2938245f14c41c0920259c87632da22`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:02.909323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4bd9a471-131b-4fee-af7a-2283ec911493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:02.983042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1067/2111] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:02.987465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9a471-131b-4fee-af7a-2283ec911493 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:03.035519 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1045/2112] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:02 2022] PUT /identity/v3/projects/292b2a36eb624924ae07c72f1d1fba6c/users/d0440e4ae28f446e8b98bea73a4adc20/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:41:03.046398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93a9a-27fd-474c-b510-3a542a939add None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:03.046656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93a9a-27fd-474c-b510-3a542a939add None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:03.046828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93a9a-27fd-474c-b510-3a542a939add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:03.060205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9a471-131b-4fee-af7a-2283ec911493 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:03.097648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-90e93a9a-27fd-474c-b510-3a542a939add None None] MFA Rules not processed for user `d0440e4ae28f446e8b98bea73a4adc20`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:03.099601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-90e93a9a-27fd-474c-b510-3a542a939add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:03.134891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c39a-b5ec-45cb-9cee-7ec3a5846eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:03.135616 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c39a-b5ec-45cb-9cee-7ec3a5846eac admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:03.135956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c39a-b5ec-45cb-9cee-7ec3a5846eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:03.136272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c39a-b5ec-45cb-9cee-7ec3a5846eac admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:03.136975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75c39a-b5ec-45cb-9cee-7ec3a5846eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:03.139067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75c39a-b5ec-45cb-9cee-7ec3a5846eac admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:03.179131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1046/2113] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:03.193964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e93a9a-27fd-474c-b510-3a542a939add None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:03.195324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-90e93a9a-27fd-474c-b510-3a542a939add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:03.257589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e93a9a-27fd-474c-b510-3a542a939add None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:03.261397 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a1e4e-7836-4a23-97e8-c997ee4f565f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:03.262053 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a1e4e-7836-4a23-97e8-c997ee4f565f service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:03.262338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a1e4e-7836-4a23-97e8-c997ee4f565f service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:03.267485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a1e4e-7836-4a23-97e8-c997ee4f565f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:03.271235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a1e4e-7836-4a23-97e8-c997ee4f565f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:03.272958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a1e4e-7836-4a23-97e8-c997ee4f565f service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:03.281867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1047/2114] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:41:03.311646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1068/2115] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:02 2022] POST /identity/v3/projects => generated 381 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:41:03.315577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a1e4e-7836-4a23-97e8-c997ee4f565f service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:03.326570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a1e4e-7836-4a23-97e8-c997ee4f565f service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:03.384734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efbc83-1307-4958-a1d4-be27f034ce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:03.385472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efbc83-1307-4958-a1d4-be27f034ce58 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:03.385813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efbc83-1307-4958-a1d4-be27f034ce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:03.386098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efbc83-1307-4958-a1d4-be27f034ce58 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:03.386796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efbc83-1307-4958-a1d4-be27f034ce58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:03.388896 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efbc83-1307-4958-a1d4-be27f034ce58 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:03.514962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:03.600257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1048/2116] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:03 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:03.604813 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c39a-b5ec-45cb-9cee-7ec3a5846eac admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:03.615075 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c39a-b5ec-45cb-9cee-7ec3a5846eac admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:03.624945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e789b8c-5d8f-46ab-bf3b-fa0e9c6b262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:03.624945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e789b8c-5d8f-46ab-bf3b-fa0e9c6b262e admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:03.624945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e789b8c-5d8f-46ab-bf3b-fa0e9c6b262e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:03.624945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e789b8c-5d8f-46ab-bf3b-fa0e9c6b262e admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:03.625346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e789b8c-5d8f-46ab-bf3b-fa0e9c6b262e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:03.625346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e789b8c-5d8f-46ab-bf3b-fa0e9c6b262e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:03.635333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1069/2117] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:03.639443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efbc83-1307-4958-a1d4-be27f034ce58 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:03.654051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efbc83-1307-4958-a1d4-be27f034ce58 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:03.659557 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d4c6f-c95e-443c-a9de-c8dcebc417f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:03.660882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d4c6f-c95e-443c-a9de-c8dcebc417f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:03.661320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d4c6f-c95e-443c-a9de-c8dcebc417f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:03.661605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d4c6f-c95e-443c-a9de-c8dcebc417f1 admin admin] PATH_INFO: `/v3/projects/e6af4e5050c04169b6ce1f053b9728b1/users/8a19105330a449b594da398cec3306a5/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:03.685129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d4c6f-c95e-443c-a9de-c8dcebc417f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6af4e5050c04169b6ce1f053b9728b1, user_id=8a19105330a449b594da398cec3306a5, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:03.687624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d4c6f-c95e-443c-a9de-c8dcebc417f1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:03.834186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1049/2118] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:03 2022] PUT /identity/v3/projects/e6af4e5050c04169b6ce1f053b9728b1/users/8a19105330a449b594da398cec3306a5/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:41:03.838650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e789b8c-5d8f-46ab-bf3b-fa0e9c6b262e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:03.850325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e789b8c-5d8f-46ab-bf3b-fa0e9c6b262e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:03.932316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41d4ce-15df-4864-9fd2-af89de0ac676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:03.932316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d4ce-15df-4864-9fd2-af89de0ac676 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:03.932316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d4ce-15df-4864-9fd2-af89de0ac676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:03.932316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d4ce-15df-4864-9fd2-af89de0ac676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:03.932832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41d4ce-15df-4864-9fd2-af89de0ac676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:03.932832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41d4ce-15df-4864-9fd2-af89de0ac676 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:03.951039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1070/2119] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:03.955500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d4c6f-c95e-443c-a9de-c8dcebc417f1 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:03.966291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:03.971492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d4c6f-c95e-443c-a9de-c8dcebc417f1 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:03.983490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6aed2-3b96-43dd-b74d-656fef685351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:03.984477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6aed2-3b96-43dd-b74d-656fef685351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:03.987955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6aed2-3b96-43dd-b74d-656fef685351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:03.987955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6aed2-3b96-43dd-b74d-656fef685351 admin admin] PATH_INFO: `/v3/projects/e6af4e5050c04169b6ce1f053b9728b1/users/8a19105330a449b594da398cec3306a5/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:03.987955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6aed2-3b96-43dd-b74d-656fef685351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6af4e5050c04169b6ce1f053b9728b1, user_id=8a19105330a449b594da398cec3306a5, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:03.990412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6aed2-3b96-43dd-b74d-656fef685351 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:04.004505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1050/2120] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:03 2022] PUT /identity/v3/projects/e6af4e5050c04169b6ce1f053b9728b1/users/8a19105330a449b594da398cec3306a5/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:41:04.015666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7e2aa-f226-456c-9ff4-a8c312ffb3a5 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:04.016622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7e2aa-f226-456c-9ff4-a8c312ffb3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:04.016622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7e2aa-f226-456c-9ff4-a8c312ffb3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:04.055977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-91d7e2aa-f226-456c-9ff4-a8c312ffb3a5 None None] MFA Rules not processed for user `8a19105330a449b594da398cec3306a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:04.057414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-91d7e2aa-f226-456c-9ff4-a8c312ffb3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:04.087741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:04.137690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1071/2121] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:04.159127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6aed2-3b96-43dd-b74d-656fef685351 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:04.221016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6aed2-3b96-43dd-b74d-656fef685351 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:04.239421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daea1d-f2b8-4838-8032-074ae3ed2d66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:04.239967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daea1d-f2b8-4838-8032-074ae3ed2d66 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:04.240303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daea1d-f2b8-4838-8032-074ae3ed2d66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:04.240587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daea1d-f2b8-4838-8032-074ae3ed2d66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:04.251799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daea1d-f2b8-4838-8032-074ae3ed2d66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:04.255250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daea1d-f2b8-4838-8032-074ae3ed2d66 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:04.267919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1051/2122] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:04.437569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30a57d-56aa-43b9-a04b-38e981b74bb9 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:04.437924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30a57d-56aa-43b9-a04b-38e981b74bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:04.438207 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30a57d-56aa-43b9-a04b-38e981b74bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:04.457231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-cc30a57d-56aa-43b9-a04b-38e981b74bb9 None None] MFA Rules not processed for user `2ab213d4944042199ee9405ed9366c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:04.458789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cc30a57d-56aa-43b9-a04b-38e981b74bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:04.519984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1072/2123] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:04.543792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daea1d-f2b8-4838-8032-074ae3ed2d66 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:04.556328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daea1d-f2b8-4838-8032-074ae3ed2d66 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:04.560195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc6b3d-0c6a-4018-b7f3-1f4e7d48dc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:04.560861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc6b3d-0c6a-4018-b7f3-1f4e7d48dc19 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:04.561145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc6b3d-0c6a-4018-b7f3-1f4e7d48dc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:04.561423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc6b3d-0c6a-4018-b7f3-1f4e7d48dc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:04.623322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc6b3d-0c6a-4018-b7f3-1f4e7d48dc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:04.624836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc6b3d-0c6a-4018-b7f3-1f4e7d48dc19 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:04.634958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1052/2124] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:04.991656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:05.231063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:05.414920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30a57d-56aa-43b9-a04b-38e981b74bb9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:05.416495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cc30a57d-56aa-43b9-a04b-38e981b74bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:05.498945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30a57d-56aa-43b9-a04b-38e981b74bb9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:05.503542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:05.504452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:05.504739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:05.505044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] PATH_INFO: `/v3/users/2532d598769d4dbe89de4ddf3924363a` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:05.506268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2532d598769d4dbe89de4ddf3924363a)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:05.508273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:05.699549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:05.713429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2532d598769d4dbe89de4ddf3924363a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:05.726391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2532d598769d4dbe89de4ddf3924363a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:05.811647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:05.840477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2532d598769d4dbe89de4ddf3924363a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:05.840832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2532d598769d4dbe89de4ddf3924363a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:05.841398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2532d598769d4dbe89de4ddf3924363a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:05.857035 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1073/2125] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:05 2022] DELETE /identity/v3/users/2532d598769d4dbe89de4ddf3924363a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:05.861631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794b76-d325-46e2-b25c-7f05dfc9defc None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:05.861915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794b76-d325-46e2-b25c-7f05dfc9defc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:05.862195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794b76-d325-46e2-b25c-7f05dfc9defc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:05.880919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f3794b76-d325-46e2-b25c-7f05dfc9defc None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:05.882833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f3794b76-d325-46e2-b25c-7f05dfc9defc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:05.946541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1053/2126] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:05.956729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:05.958545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:06.017791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29241052-1d4c-465e-b70f-a41be2d2b179 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:06.021787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57361e-e253-40b5-acd1-75ca13bc3c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:06.022963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57361e-e253-40b5-acd1-75ca13bc3c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:06.023331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57361e-e253-40b5-acd1-75ca13bc3c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:06.023636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57361e-e253-40b5-acd1-75ca13bc3c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:06.033778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57361e-e253-40b5-acd1-75ca13bc3c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:06.035328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57361e-e253-40b5-acd1-75ca13bc3c7b service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:06.046197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1074/2127] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:06.055619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:06.246777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:06.560181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:06.653801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:06.671105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3794b76-d325-46e2-b25c-7f05dfc9defc None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:06.672959 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f3794b76-d325-46e2-b25c-7f05dfc9defc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:06.695526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3794b76-d325-46e2-b25c-7f05dfc9defc None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:06.714616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:06.715460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:06.715743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:06.716018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] PATH_INFO: `/v3/projects/190eb71058004be7a3bfcfc08259126e` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:06.717713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=190eb71058004be7a3bfcfc08259126e)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:06.720033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:06.865412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190eb71058004be7a3bfcfc08259126e', 'request_id': 'req-274dbcdd-2d12-456a-8708-0101bead5700'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:06.873968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190eb71058004be7a3bfcfc08259126e', 'request_id': 'req-274dbcdd-2d12-456a-8708-0101bead5700'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:06.932403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190eb71058004be7a3bfcfc08259126e', 'request_id': 'req-274dbcdd-2d12-456a-8708-0101bead5700'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:06.947491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] The token cache is being invalidate because project 190eb71058004be7a3bfcfc08259126e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:06.947850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:06.948608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:06.950186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1054/2128] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:06 2022] DELETE /identity/v3/projects/190eb71058004be7a3bfcfc08259126e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:06.954736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57361e-e253-40b5-acd1-75ca13bc3c7b service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:06.974082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57361e-e253-40b5-acd1-75ca13bc3c7b service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:07.024763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:07.025725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:07.026010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:07.026288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] PATH_INFO: `/v3/users/195237c2a601453c81454f4ae26e42eb` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:07.027491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195237c2a601453c81454f4ae26e42eb)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:07.029441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:07.367760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:07.376672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195237c2a601453c81454f4ae26e42eb'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:07.398675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195237c2a601453c81454f4ae26e42eb'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:07.533661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:07.535741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195237c2a601453c81454f4ae26e42eb'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:07.542100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195237c2a601453c81454f4ae26e42eb'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:07.542100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5a6bac76-2c3c-4f2b-88cb-7713f03e9067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195237c2a601453c81454f4ae26e42eb'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:07.558338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1075/2129] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:06 2022] DELETE /identity/v3/users/195237c2a601453c81454f4ae26e42eb => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:08.241722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:08.244322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:08.265233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbcdd-2d12-456a-8708-0101bead5700 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:08.339976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:08.340877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:08.341187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:08.341485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] PATH_INFO: `/v3/projects/f570b68a58da48a3ad2d2562e20326ad` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:08.342676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f570b68a58da48a3ad2d2562e20326ad)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:08.344672 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:08.493949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f570b68a58da48a3ad2d2562e20326ad', 'request_id': 'req-8a27b6ec-40d6-4b68-83a1-e3a57957614c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:08.500762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f570b68a58da48a3ad2d2562e20326ad', 'request_id': 'req-8a27b6ec-40d6-4b68-83a1-e3a57957614c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:08.577754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f570b68a58da48a3ad2d2562e20326ad', 'request_id': 'req-8a27b6ec-40d6-4b68-83a1-e3a57957614c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:08.595121 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] The token cache is being invalidate because project f570b68a58da48a3ad2d2562e20326ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:08.595489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:08.596143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8a27b6ec-40d6-4b68-83a1-e3a57957614c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:08.598058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1055/2130] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:08 2022] DELETE /identity/v3/projects/f570b68a58da48a3ad2d2562e20326ad => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:08.603705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dba23-36d8-407a-abdd-35b7280ac5cc None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:08.604208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dba23-36d8-407a-abdd-35b7280ac5cc None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:08.604700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dba23-36d8-407a-abdd-35b7280ac5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:08.648464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-bf5dba23-36d8-407a-abdd-35b7280ac5cc None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:08.650365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-bf5dba23-36d8-407a-abdd-35b7280ac5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:08.738435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1076/2131] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:08.747547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b56295-ddfb-4520-879a-bffed46845c6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:08.748167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b56295-ddfb-4520-879a-bffed46845c6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:08.748528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b56295-ddfb-4520-879a-bffed46845c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:08.774981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d3b56295-ddfb-4520-879a-bffed46845c6 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:08.780285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d3b56295-ddfb-4520-879a-bffed46845c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:08.797832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1056/2132] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:08.806707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dba23-36d8-407a-abdd-35b7280ac5cc None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:08.818249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dba23-36d8-407a-abdd-35b7280ac5cc None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:08.824334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57537800-6ce5-4c2a-b384-d49f696aaa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:08.825297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57537800-6ce5-4c2a-b384-d49f696aaa83 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:08.825578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57537800-6ce5-4c2a-b384-d49f696aaa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:08.825843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57537800-6ce5-4c2a-b384-d49f696aaa83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:08.826910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57537800-6ce5-4c2a-b384-d49f696aaa83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:41:08.827220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57537800-6ce5-4c2a-b384-d49f696aaa83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:08.828881 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57537800-6ce5-4c2a-b384-d49f696aaa83 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:08.842941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1077/2133] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:41:08.848941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b56295-ddfb-4520-879a-bffed46845c6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:08.861193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b56295-ddfb-4520-879a-bffed46845c6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:08.869216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb93de-76f5-467c-951f-b05826999e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:08.870063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb93de-76f5-467c-951f-b05826999e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:08.870347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb93de-76f5-467c-951f-b05826999e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:08.870685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb93de-76f5-467c-951f-b05826999e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:08.871423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb93de-76f5-467c-951f-b05826999e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:08.874184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb93de-76f5-467c-951f-b05826999e32 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:09.008185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1057/2134] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:08 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:09.009460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57537800-6ce5-4c2a-b384-d49f696aaa83 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:09.020050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57537800-6ce5-4c2a-b384-d49f696aaa83 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:09.096058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501dd30-ff53-4039-8be7-657f7b75599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:09.096763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501dd30-ff53-4039-8be7-657f7b75599a admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:09.097046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501dd30-ff53-4039-8be7-657f7b75599a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:09.097323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501dd30-ff53-4039-8be7-657f7b75599a admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:09.098025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501dd30-ff53-4039-8be7-657f7b75599a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:09.099941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501dd30-ff53-4039-8be7-657f7b75599a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:09.253314 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1078/2135] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:09 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:41:09.259115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb93de-76f5-467c-951f-b05826999e32 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:09.272685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb93de-76f5-467c-951f-b05826999e32 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:09.279510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4583d7-ca37-4e27-913f-06c7ead64258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:09.280237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4583d7-ca37-4e27-913f-06c7ead64258 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:09.280512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4583d7-ca37-4e27-913f-06c7ead64258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:09.281037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4583d7-ca37-4e27-913f-06c7ead64258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:09.281958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4583d7-ca37-4e27-913f-06c7ead64258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:09.284129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4583d7-ca37-4e27-913f-06c7ead64258 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:09.298755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1058/2136] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:09.303929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501dd30-ff53-4039-8be7-657f7b75599a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:09.321572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501dd30-ff53-4039-8be7-657f7b75599a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:09.326940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ff4f6-5f03-4b57-9699-13bb922ec511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:09.327643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ff4f6-5f03-4b57-9699-13bb922ec511 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:09.327927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ff4f6-5f03-4b57-9699-13bb922ec511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:09.328235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ff4f6-5f03-4b57-9699-13bb922ec511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:09.328976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ff4f6-5f03-4b57-9699-13bb922ec511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:09.330614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ff4f6-5f03-4b57-9699-13bb922ec511 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:09.344126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1079/2137] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:09.347053 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4583d7-ca37-4e27-913f-06c7ead64258 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:09.359336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4583d7-ca37-4e27-913f-06c7ead64258 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:09.365337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff03657-83c0-4221-af6d-2a8d03b2d8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:09.367671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff03657-83c0-4221-af6d-2a8d03b2d8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:09.367671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff03657-83c0-4221-af6d-2a8d03b2d8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:09.367671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff03657-83c0-4221-af6d-2a8d03b2d8e2 admin admin] PATH_INFO: `/v3/projects/f76b1075f4754bf9a04b994ccfb7f3de/users/c6fe7c0a86dc477a99cfc7d5065dfb19/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:09.383688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff03657-83c0-4221-af6d-2a8d03b2d8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76b1075f4754bf9a04b994ccfb7f3de, user_id=c6fe7c0a86dc477a99cfc7d5065dfb19, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:09.386379 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff03657-83c0-4221-af6d-2a8d03b2d8e2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:09.417365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:09.493727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:09.495096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ff4f6-5f03-4b57-9699-13bb922ec511 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:09.497068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8a7ff4f6-5f03-4b57-9699-13bb922ec511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:09.499567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1059/2138] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:09 2022] PUT /identity/v3/projects/f76b1075f4754bf9a04b994ccfb7f3de/users/c6fe7c0a86dc477a99cfc7d5065dfb19/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:41:09.510844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41917-b8a3-46c2-9105-e42098c56222 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:09.511055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ff4f6-5f03-4b57-9699-13bb922ec511 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:09.511558 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41917-b8a3-46c2-9105-e42098c56222 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:09.511558 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41917-b8a3-46c2-9105-e42098c56222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:09.544542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-14a41917-b8a3-46c2-9105-e42098c56222 None None] MFA Rules not processed for user `c6fe7c0a86dc477a99cfc7d5065dfb19`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:09.546254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-14a41917-b8a3-46c2-9105-e42098c56222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:09.604368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:09.605266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:09.605556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:09.608543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] PATH_INFO: `/v3/users/d0440e4ae28f446e8b98bea73a4adc20` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:09.608543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0440e4ae28f446e8b98bea73a4adc20)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:09.609065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:09.638150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1060/2139] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:09.658402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a41917-b8a3-46c2-9105-e42098c56222 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:09.658402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-14a41917-b8a3-46c2-9105-e42098c56222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:09.712924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a41917-b8a3-46c2-9105-e42098c56222 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:09.718710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98260d3-fe53-45c8-9dfb-a528575fbf8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff915d0b23d4b9ebd70e6b6b885aca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:09.719363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98260d3-fe53-45c8-9dfb-a528575fbf8e service glance] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:09.719647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98260d3-fe53-45c8-9dfb-a528575fbf8e service glance] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:09.719986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98260d3-fe53-45c8-9dfb-a528575fbf8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:09.730647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98260d3-fe53-45c8-9dfb-a528575fbf8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:09.732095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98260d3-fe53-45c8-9dfb-a528575fbf8e service glance] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:09.745471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1061/2140] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:41:09.884397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0440e4ae28f446e8b98bea73a4adc20'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:09.900057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0440e4ae28f446e8b98bea73a4adc20'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:10.156995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0440e4ae28f446e8b98bea73a4adc20'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:10.156995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0440e4ae28f446e8b98bea73a4adc20'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:10.156995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0440e4ae28f446e8b98bea73a4adc20'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:10.156995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1080/2141] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:09 2022] DELETE /identity/v3/users/d0440e4ae28f446e8b98bea73a4adc20 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:10.168206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3a08-0678-4b9a-b0b4-6fb3640b4a6e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:10.168512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3a08-0678-4b9a-b0b4-6fb3640b4a6e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:10.168778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3a08-0678-4b9a-b0b4-6fb3640b4a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:10.187419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-45ea3a08-0678-4b9a-b0b4-6fb3640b4a6e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:10.189807 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-45ea3a08-0678-4b9a-b0b4-6fb3640b4a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:10.270800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1062/2142] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:10.280939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:10.282523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:10.347858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb3fe6-8b24-4534-a74d-b17fb5e73446 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:10.352318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ed0f4-d700-4b16-b90f-d743a7f5b38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:10.352994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ed0f4-d700-4b16-b90f-d743a7f5b38e service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:10.353281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ed0f4-d700-4b16-b90f-d743a7f5b38e service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:10.353785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ed0f4-d700-4b16-b90f-d743a7f5b38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:10.363741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ed0f4-d700-4b16-b90f-d743a7f5b38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:10.365232 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ed0f4-d700-4b16-b90f-d743a7f5b38e service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:10.376613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1081/2143] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:11.317679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3a08-0678-4b9a-b0b4-6fb3640b4a6e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:11.318357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-45ea3a08-0678-4b9a-b0b4-6fb3640b4a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:11.332698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3a08-0678-4b9a-b0b4-6fb3640b4a6e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:11.338452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:11.339508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:11.339856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:11.340235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] PATH_INFO: `/v3/projects/292b2a36eb624924ae07c72f1d1fba6c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:11.346486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=292b2a36eb624924ae07c72f1d1fba6c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:11.346486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:11.472643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292b2a36eb624924ae07c72f1d1fba6c', 'request_id': 'req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:11.479456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292b2a36eb624924ae07c72f1d1fba6c', 'request_id': 'req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:11.497450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:11.531419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292b2a36eb624924ae07c72f1d1fba6c', 'request_id': 'req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:11.544904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:11.550568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] The token cache is being invalidate because project 292b2a36eb624924ae07c72f1d1fba6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:11.551022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:11.551968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4f549004-6bfd-4b0f-8cc2-d1cd177aa729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:11.555419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1063/2144] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:11 2022] DELETE /identity/v3/projects/292b2a36eb624924ae07c72f1d1fba6c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:11.564871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a9ac-8e26-4891-8661-53248956093e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:11.565634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a9ac-8e26-4891-8661-53248956093e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:11.566223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36a9ac-8e26-4891-8661-53248956093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:11.602237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6b36a9ac-8e26-4891-8661-53248956093e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:11.602237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6b36a9ac-8e26-4891-8661-53248956093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:11.686199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1082/2145] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:11.702756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cca4e-5879-4b1c-90fd-5e544de7f1b5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:11.703387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cca4e-5879-4b1c-90fd-5e544de7f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:11.703882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cca4e-5879-4b1c-90fd-5e544de7f1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:11.724916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8a9cca4e-5879-4b1c-90fd-5e544de7f1b5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:11.726159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8a9cca4e-5879-4b1c-90fd-5e544de7f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:11.734460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1064/2146] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:11.738756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36a9ac-8e26-4891-8661-53248956093e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:11.750941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36a9ac-8e26-4891-8661-53248956093e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:11.756362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e238b9-70b8-4d2e-9697-ade4e9a6dd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:11.757037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e238b9-70b8-4d2e-9697-ade4e9a6dd14 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:11.757482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e238b9-70b8-4d2e-9697-ade4e9a6dd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:11.758328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e238b9-70b8-4d2e-9697-ade4e9a6dd14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:11.759102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e238b9-70b8-4d2e-9697-ade4e9a6dd14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:41:11.759410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e238b9-70b8-4d2e-9697-ade4e9a6dd14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:11.761101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e238b9-70b8-4d2e-9697-ade4e9a6dd14 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:11.782088 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1083/2147] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:41:11.786412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cca4e-5879-4b1c-90fd-5e544de7f1b5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:11.796778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cca4e-5879-4b1c-90fd-5e544de7f1b5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:11.801644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584062-57da-4585-b2fa-8ac2a8737808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:11.802344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584062-57da-4585-b2fa-8ac2a8737808 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:11.802631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584062-57da-4585-b2fa-8ac2a8737808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:11.802925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584062-57da-4585-b2fa-8ac2a8737808 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:11.803612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef584062-57da-4585-b2fa-8ac2a8737808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:11.806118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef584062-57da-4585-b2fa-8ac2a8737808 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:11.932753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1065/2148] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:11 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:11.934160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e238b9-70b8-4d2e-9697-ade4e9a6dd14 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:11.952579 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e238b9-70b8-4d2e-9697-ade4e9a6dd14 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:12.030501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723deda6-006f-48ac-b679-0ad101011451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:12.031210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723deda6-006f-48ac-b679-0ad101011451 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:12.031491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723deda6-006f-48ac-b679-0ad101011451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:12.031768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723deda6-006f-48ac-b679-0ad101011451 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:12.032486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723deda6-006f-48ac-b679-0ad101011451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:12.034521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723deda6-006f-48ac-b679-0ad101011451 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:12.121919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1084/2149] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:11 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:12.125952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584062-57da-4585-b2fa-8ac2a8737808 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:12.139510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584062-57da-4585-b2fa-8ac2a8737808 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:12.155871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009461b-7324-4637-b50a-97f9e9dfdc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:12.156616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009461b-7324-4637-b50a-97f9e9dfdc0e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:12.157124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009461b-7324-4637-b50a-97f9e9dfdc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:12.157519 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009461b-7324-4637-b50a-97f9e9dfdc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:12.158336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009461b-7324-4637-b50a-97f9e9dfdc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:12.161711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009461b-7324-4637-b50a-97f9e9dfdc0e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:12.178483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1066/2150] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:12.183036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723deda6-006f-48ac-b679-0ad101011451 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:12.195505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723deda6-006f-48ac-b679-0ad101011451 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:12.201771 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d52fe6-3273-466c-b33c-c6c288cbbbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:12.202841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d52fe6-3273-466c-b33c-c6c288cbbbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:12.215155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d52fe6-3273-466c-b33c-c6c288cbbbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:12.215155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d52fe6-3273-466c-b33c-c6c288cbbbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:12.215155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d52fe6-3273-466c-b33c-c6c288cbbbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:12.215155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d52fe6-3273-466c-b33c-c6c288cbbbe5 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:12.219717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1085/2151] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:12.224283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009461b-7324-4637-b50a-97f9e9dfdc0e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:12.235296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009461b-7324-4637-b50a-97f9e9dfdc0e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:12.246330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c36b-c6e4-4ba9-b4bf-087ac8ecb208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:12.246330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c36b-c6e4-4ba9-b4bf-087ac8ecb208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:12.246330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c36b-c6e4-4ba9-b4bf-087ac8ecb208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:12.246330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c36b-c6e4-4ba9-b4bf-087ac8ecb208 admin admin] PATH_INFO: `/v3/projects/d762d64492a842b4ba0df30bb4747ae6/users/8ce7a97f83bc44f9bf7d6540d02881b3/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:12.260793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361c36b-c6e4-4ba9-b4bf-087ac8ecb208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d762d64492a842b4ba0df30bb4747ae6, user_id=8ce7a97f83bc44f9bf7d6540d02881b3, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:12.263579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361c36b-c6e4-4ba9-b4bf-087ac8ecb208 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:12.333045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1067/2152] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:12 2022] PUT /identity/v3/projects/d762d64492a842b4ba0df30bb4747ae6/users/8ce7a97f83bc44f9bf7d6540d02881b3/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:12.345328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8fb6-73c1-4aef-a66f-e005969d22bd None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:12.345623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8fb6-73c1-4aef-a66f-e005969d22bd None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:12.345905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8fb6-73c1-4aef-a66f-e005969d22bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:12.373716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-fc7f8fb6-73c1-4aef-a66f-e005969d22bd None None] MFA Rules not processed for user `8ce7a97f83bc44f9bf7d6540d02881b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:12.374925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fc7f8fb6-73c1-4aef-a66f-e005969d22bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:12.442308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1086/2153] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:12.454521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c36b-c6e4-4ba9-b4bf-087ac8ecb208 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:12.456606 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8361c36b-c6e4-4ba9-b4bf-087ac8ecb208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:12.518299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c36b-c6e4-4ba9-b4bf-087ac8ecb208 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:12.523023 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fde59-d115-4747-8038-cf37d873e671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:12.523758 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fde59-d115-4747-8038-cf37d873e671 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:12.524046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fde59-d115-4747-8038-cf37d873e671 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:12.524362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fde59-d115-4747-8038-cf37d873e671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:12.533042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fde59-d115-4747-8038-cf37d873e671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:12.534781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fde59-d115-4747-8038-cf37d873e671 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:12.544049 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1068/2154] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:12.602538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:12.988922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:13.811419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:13.869056 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:14.748446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:14.777252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:14.983126 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:15.086690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:15.143529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:15.754589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:15.789474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:16.165788 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:16.360245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:16.639984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:16.915116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:18.179807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:18.771127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:19.416132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f8fb6-73c1-4aef-a66f-e005969d22bd None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:19.418219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fc7f8fb6-73c1-4aef-a66f-e005969d22bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:19.485189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f8fb6-73c1-4aef-a66f-e005969d22bd None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:19.489984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:19.490893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:19.491176 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:19.491448 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] PATH_INFO: `/v3/users/b2938245f14c41c0920259c87632da22` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:19.493301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2938245f14c41c0920259c87632da22)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:19.495220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:19.664248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:19.676250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2938245f14c41c0920259c87632da22'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:19.690849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2938245f14c41c0920259c87632da22'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:19.765969 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2938245f14c41c0920259c87632da22'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:19.766834 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2938245f14c41c0920259c87632da22'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:19.767708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2938245f14c41c0920259c87632da22'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:19.786467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1087/2155] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:19 2022] DELETE /identity/v3/users/b2938245f14c41c0920259c87632da22 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:19.791703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791609-f216-490d-8dcf-e3a7ff9cdab2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:19.792262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791609-f216-490d-8dcf-e3a7ff9cdab2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:19.792387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791609-f216-490d-8dcf-e3a7ff9cdab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:19.810637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0f791609-f216-490d-8dcf-e3a7ff9cdab2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:19.811845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0f791609-f216-490d-8dcf-e3a7ff9cdab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:19.872111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1069/2156] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:19.882028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:19.883804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:19.944324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c34eae-5d2e-4cc2-b7eb-3b33fed276d6 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:19.949877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02244f-046a-4751-9121-ab3af4391254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:19.950714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02244f-046a-4751-9121-ab3af4391254 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:19.951132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02244f-046a-4751-9121-ab3af4391254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:19.951582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02244f-046a-4751-9121-ab3af4391254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:19.968373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02244f-046a-4751-9121-ab3af4391254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:19.969875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02244f-046a-4751-9121-ab3af4391254 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:19.982690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1088/2157] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:41:20.216960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:20.468677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:20.516064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f791609-f216-490d-8dcf-e3a7ff9cdab2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:20.517824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0f791609-f216-490d-8dcf-e3a7ff9cdab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:20.534832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f791609-f216-490d-8dcf-e3a7ff9cdab2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:20.541955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:20.542414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:20.542700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:20.542982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] PATH_INFO: `/v3/projects/54ac4eb0aec24c37b29940083d7f8084` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:20.544228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ac4eb0aec24c37b29940083d7f8084)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:20.546981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:20.713327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ac4eb0aec24c37b29940083d7f8084', 'request_id': 'req-fed81a3b-352c-44ce-bd8d-b991cdc62785'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:20.725311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ac4eb0aec24c37b29940083d7f8084', 'request_id': 'req-fed81a3b-352c-44ce-bd8d-b991cdc62785'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:20.805697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ac4eb0aec24c37b29940083d7f8084', 'request_id': 'req-fed81a3b-352c-44ce-bd8d-b991cdc62785'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:20.818589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] The token cache is being invalidate because project 54ac4eb0aec24c37b29940083d7f8084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:20.818881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:20.819524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:20.821680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1070/2158] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:20 2022] DELETE /identity/v3/projects/54ac4eb0aec24c37b29940083d7f8084 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:20.825739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02244f-046a-4751-9121-ab3af4391254 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:20.837675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02244f-046a-4751-9121-ab3af4391254 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:20.899406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:20.900336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:20.900623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:20.900901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] PATH_INFO: `/v3/users/8a19105330a449b594da398cec3306a5` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:20.902156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a19105330a449b594da398cec3306a5)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:20.904152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:21.198525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a19105330a449b594da398cec3306a5'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:21.214313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:21.215659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a19105330a449b594da398cec3306a5'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:21.292179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a19105330a449b594da398cec3306a5'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:21.292719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a19105330a449b594da398cec3306a5'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:21.293512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f5d6f0ce-59f3-4850-ae0b-bf4f10a285f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a19105330a449b594da398cec3306a5'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:21.309419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:21.316539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1089/2159] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:20 2022] DELETE /identity/v3/users/8a19105330a449b594da398cec3306a5 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:21.815495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:21.817847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:21.853301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed81a3b-352c-44ce-bd8d-b991cdc62785 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:21.927667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:21.928580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:21.928937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:21.929373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] PATH_INFO: `/v3/projects/e6af4e5050c04169b6ce1f053b9728b1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:21.930714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6af4e5050c04169b6ce1f053b9728b1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:21.932745 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:21.954816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:22.058177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6af4e5050c04169b6ce1f053b9728b1', 'request_id': 'req-5485ab70-558d-4212-8e1c-6865814bf3a1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:22.064517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6af4e5050c04169b6ce1f053b9728b1', 'request_id': 'req-5485ab70-558d-4212-8e1c-6865814bf3a1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:22.159552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6af4e5050c04169b6ce1f053b9728b1', 'request_id': 'req-5485ab70-558d-4212-8e1c-6865814bf3a1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:22.176824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] The token cache is being invalidate because project e6af4e5050c04169b6ce1f053b9728b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:22.177123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:22.177803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5485ab70-558d-4212-8e1c-6865814bf3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:22.179394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1071/2160] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:21 2022] DELETE /identity/v3/projects/e6af4e5050c04169b6ce1f053b9728b1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:22.184621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea1738-0702-42fc-8e40-29f522bcda1d None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:22.184913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea1738-0702-42fc-8e40-29f522bcda1d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:22.185193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea1738-0702-42fc-8e40-29f522bcda1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:22.204862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-7aea1738-0702-42fc-8e40-29f522bcda1d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:22.206091 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7aea1738-0702-42fc-8e40-29f522bcda1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:22.270298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1090/2161] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:22.278826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0241-1473-44fb-8b3e-4ad458710943 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:22.279111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0241-1473-44fb-8b3e-4ad458710943 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:22.279441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0241-1473-44fb-8b3e-4ad458710943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:22.299952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-123f0241-1473-44fb-8b3e-4ad458710943 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:22.301194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-123f0241-1473-44fb-8b3e-4ad458710943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:22.314596 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1072/2162] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:22.319182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea1738-0702-42fc-8e40-29f522bcda1d None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:22.320379 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:22.331012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea1738-0702-42fc-8e40-29f522bcda1d None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:22.336806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade95886-0612-453f-8122-d32852bead8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:22.337488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade95886-0612-453f-8122-d32852bead8c admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:22.337776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade95886-0612-453f-8122-d32852bead8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:22.338054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade95886-0612-453f-8122-d32852bead8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:22.338788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade95886-0612-453f-8122-d32852bead8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:41:22.339100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade95886-0612-453f-8122-d32852bead8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:22.340760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade95886-0612-453f-8122-d32852bead8c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:22.353357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1091/2163] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:41:22.357785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f0241-1473-44fb-8b3e-4ad458710943 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:22.369969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f0241-1473-44fb-8b3e-4ad458710943 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:22.374721 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a066aae-1b38-4229-b992-b4da7e2331ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:22.375381 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a066aae-1b38-4229-b992-b4da7e2331ab admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:22.375662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a066aae-1b38-4229-b992-b4da7e2331ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:22.375933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a066aae-1b38-4229-b992-b4da7e2331ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:22.376661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a066aae-1b38-4229-b992-b4da7e2331ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:22.378730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a066aae-1b38-4229-b992-b4da7e2331ab admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:22.549890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1073/2164] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:22 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:22.555935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade95886-0612-453f-8122-d32852bead8c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:22.566058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade95886-0612-453f-8122-d32852bead8c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:22.626749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173156b3-edc9-4062-9ef7-4a7e574b9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:22.627425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173156b3-edc9-4062-9ef7-4a7e574b9db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:22.627708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173156b3-edc9-4062-9ef7-4a7e574b9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:22.627980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173156b3-edc9-4062-9ef7-4a7e574b9db1 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:22.628694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173156b3-edc9-4062-9ef7-4a7e574b9db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:22.630605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173156b3-edc9-4062-9ef7-4a7e574b9db1 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:22.680673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:22.736734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1092/2165] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:22 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:22.738133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a066aae-1b38-4229-b992-b4da7e2331ab admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:22.750116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a066aae-1b38-4229-b992-b4da7e2331ab admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:22.755804 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec429b2-eb54-4428-a71a-37090c39af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:22.756516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec429b2-eb54-4428-a71a-37090c39af9f admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:22.757542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec429b2-eb54-4428-a71a-37090c39af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:22.758167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec429b2-eb54-4428-a71a-37090c39af9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:22.759049 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec429b2-eb54-4428-a71a-37090c39af9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:22.761106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec429b2-eb54-4428-a71a-37090c39af9f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:22.777931 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1074/2166] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:22.781178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173156b3-edc9-4062-9ef7-4a7e574b9db1 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:22.796310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173156b3-edc9-4062-9ef7-4a7e574b9db1 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:22.800996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a078c-3197-4031-b9d7-e5f6f33bfa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:22.801662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a078c-3197-4031-b9d7-e5f6f33bfa36 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:22.802101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a078c-3197-4031-b9d7-e5f6f33bfa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:22.802380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a078c-3197-4031-b9d7-e5f6f33bfa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:22.803099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a078c-3197-4031-b9d7-e5f6f33bfa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:22.805504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a078c-3197-4031-b9d7-e5f6f33bfa36 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:22.811276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:22.816206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1093/2167] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:22.820920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec429b2-eb54-4428-a71a-37090c39af9f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:22.831019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec429b2-eb54-4428-a71a-37090c39af9f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:22.834460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:22.837021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233e049-9c73-4d1c-826c-670b8bde27a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:22.837938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e049-9c73-4d1c-826c-670b8bde27a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:22.838237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e049-9c73-4d1c-826c-670b8bde27a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:22.838504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e049-9c73-4d1c-826c-670b8bde27a7 admin admin] PATH_INFO: `/v3/projects/d713e5cac1824dc69b7b48b4d52e4a73/users/f958ee17b2b24265b1e23311f36aa227/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:22.853841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233e049-9c73-4d1c-826c-670b8bde27a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d713e5cac1824dc69b7b48b4d52e4a73, user_id=f958ee17b2b24265b1e23311f36aa227, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:22.856647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233e049-9c73-4d1c-826c-670b8bde27a7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:22.961750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1075/2168] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:22 2022] PUT /identity/v3/projects/d713e5cac1824dc69b7b48b4d52e4a73/users/f958ee17b2b24265b1e23311f36aa227/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:41:22.973280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea962f-a213-44aa-aa0b-f7037052b9ba None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:22.974257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea962f-a213-44aa-aa0b-f7037052b9ba None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:22.974548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea962f-a213-44aa-aa0b-f7037052b9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:23.006447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-94ea962f-a213-44aa-aa0b-f7037052b9ba None None] MFA Rules not processed for user `f958ee17b2b24265b1e23311f36aa227`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:23.009201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-94ea962f-a213-44aa-aa0b-f7037052b9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:23.086972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1094/2169] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:23.091114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233e049-9c73-4d1c-826c-670b8bde27a7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:23.169027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:23.172286 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233e049-9c73-4d1c-826c-670b8bde27a7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:23.178037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cc429-e4b9-428d-bd3e-b6cb123ea147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:23.179770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cc429-e4b9-428d-bd3e-b6cb123ea147 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:23.179770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cc429-e4b9-428d-bd3e-b6cb123ea147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:23.179770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cc429-e4b9-428d-bd3e-b6cb123ea147 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:23.180680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cc429-e4b9-428d-bd3e-b6cb123ea147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:23.183326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cc429-e4b9-428d-bd3e-b6cb123ea147 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:23.297073 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1076/2170] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:23 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:23.298203 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea962f-a213-44aa-aa0b-f7037052b9ba None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:23.309801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea962f-a213-44aa-aa0b-f7037052b9ba None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:23.375022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab9a0-85c7-4b0a-a13d-25e7b40b9c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:23.375916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab9a0-85c7-4b0a-a13d-25e7b40b9c0d admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:23.376304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab9a0-85c7-4b0a-a13d-25e7b40b9c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:23.376658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab9a0-85c7-4b0a-a13d-25e7b40b9c0d admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:23.377904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ab9a0-85c7-4b0a-a13d-25e7b40b9c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:23.379421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ab9a0-85c7-4b0a-a13d-25e7b40b9c0d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:23.574721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1095/2171] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:23 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:23.603007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cc429-e4b9-428d-bd3e-b6cb123ea147 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:23.614769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cc429-e4b9-428d-bd3e-b6cb123ea147 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:23.622299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4e521-11f2-4447-a7ba-1ef8bb73282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:23.623940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e521-11f2-4447-a7ba-1ef8bb73282f admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:23.624331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e521-11f2-4447-a7ba-1ef8bb73282f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:23.625045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e521-11f2-4447-a7ba-1ef8bb73282f admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:23.625919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4e521-11f2-4447-a7ba-1ef8bb73282f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:23.627669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4e521-11f2-4447-a7ba-1ef8bb73282f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:23.647485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1077/2172] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:23.648696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab9a0-85c7-4b0a-a13d-25e7b40b9c0d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:23.666210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab9a0-85c7-4b0a-a13d-25e7b40b9c0d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:23.684389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743784f0-1672-40a6-83ae-8bf34c84bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:23.684389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743784f0-1672-40a6-83ae-8bf34c84bce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:23.684389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743784f0-1672-40a6-83ae-8bf34c84bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:23.684389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743784f0-1672-40a6-83ae-8bf34c84bce1 admin admin] PATH_INFO: `/v3/projects/159392c36e1a4e36afdb3847e1fb04a8/users/ce532c9ac7864e1ea18ca69508747dc4/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:23.705976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:23.708428 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743784f0-1672-40a6-83ae-8bf34c84bce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159392c36e1a4e36afdb3847e1fb04a8, user_id=ce532c9ac7864e1ea18ca69508747dc4, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:23.711650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743784f0-1672-40a6-83ae-8bf34c84bce1 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:23.772492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:23.797863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1096/2173] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:23 2022] PUT /identity/v3/projects/159392c36e1a4e36afdb3847e1fb04a8/users/ce532c9ac7864e1ea18ca69508747dc4/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:23.801566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4e521-11f2-4447-a7ba-1ef8bb73282f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:23.814191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4e521-11f2-4447-a7ba-1ef8bb73282f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:23.881207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541213a-199f-4752-a623-52c7f686c959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:23.881915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541213a-199f-4752-a623-52c7f686c959 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:23.882255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541213a-199f-4752-a623-52c7f686c959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:23.882907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541213a-199f-4752-a623-52c7f686c959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:23.883503 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541213a-199f-4752-a623-52c7f686c959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:23.885087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541213a-199f-4752-a623-52c7f686c959 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:23.898079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1078/2174] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:41:23.907728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743784f0-1672-40a6-83ae-8bf34c84bce1 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:23.920472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743784f0-1672-40a6-83ae-8bf34c84bce1 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:23.925331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecff940-025f-4b69-ab33-4c610c7b0638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:23.926317 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecff940-025f-4b69-ab33-4c610c7b0638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:23.926602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecff940-025f-4b69-ab33-4c610c7b0638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:23.926893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecff940-025f-4b69-ab33-4c610c7b0638 admin admin] PATH_INFO: `/v3/projects/159392c36e1a4e36afdb3847e1fb04a8/users/ce532c9ac7864e1ea18ca69508747dc4/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:23.929900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecff940-025f-4b69-ab33-4c610c7b0638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159392c36e1a4e36afdb3847e1fb04a8, user_id=ce532c9ac7864e1ea18ca69508747dc4, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:23.933164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecff940-025f-4b69-ab33-4c610c7b0638 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:23.944860 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1097/2175] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:23 2022] PUT /identity/v3/projects/159392c36e1a4e36afdb3847e1fb04a8/users/ce532c9ac7864e1ea18ca69508747dc4/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:23.955840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea322-362a-44db-a0e9-f6c0157aa3f0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:23.956196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea322-362a-44db-a0e9-f6c0157aa3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:23.956483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea322-362a-44db-a0e9-f6c0157aa3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:23.973640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:23.990534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f2dea322-362a-44db-a0e9-f6c0157aa3f0 None None] MFA Rules not processed for user `ce532c9ac7864e1ea18ca69508747dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:23.991937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f2dea322-362a-44db-a0e9-f6c0157aa3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:24.064585 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1079/2176] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:24.091511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:24.109216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecff940-025f-4b69-ab33-4c610c7b0638 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:24.111160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0ecff940-025f-4b69-ab33-4c610c7b0638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:24.194989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:24.203171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecff940-025f-4b69-ab33-4c610c7b0638 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:24.206270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bbc39-96f1-4181-a80d-170aad29ae13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:24.207862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbc39-96f1-4181-a80d-170aad29ae13 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:24.208418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbc39-96f1-4181-a80d-170aad29ae13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:24.208994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbc39-96f1-4181-a80d-170aad29ae13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:24.221378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bbc39-96f1-4181-a80d-170aad29ae13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:24.225492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bbc39-96f1-4181-a80d-170aad29ae13 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:24.238856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1098/2177] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:24.279929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:24.342789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:24.777158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:24.875582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea322-362a-44db-a0e9-f6c0157aa3f0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:24.938370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea322-362a-44db-a0e9-f6c0157aa3f0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:24.943369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:24.944358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:24.944647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:24.946151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] PATH_INFO: `/v3/users/f958ee17b2b24265b1e23311f36aa227` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:24.947391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f958ee17b2b24265b1e23311f36aa227)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:24.949349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:25.062360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:25.132948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f958ee17b2b24265b1e23311f36aa227'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:25.144896 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f958ee17b2b24265b1e23311f36aa227'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:25.228409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f958ee17b2b24265b1e23311f36aa227'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:25.237127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f958ee17b2b24265b1e23311f36aa227'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:25.237127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f958ee17b2b24265b1e23311f36aa227'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:25.243367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1080/2178] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:24 2022] DELETE /identity/v3/users/f958ee17b2b24265b1e23311f36aa227 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:25.247930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9d355-49c2-4feb-a6f5-4868a692b204 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:25.248420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9d355-49c2-4feb-a6f5-4868a692b204 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:25.248628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9d355-49c2-4feb-a6f5-4868a692b204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:25.267343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-77a9d355-49c2-4feb-a6f5-4868a692b204 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:25.268591 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-77a9d355-49c2-4feb-a6f5-4868a692b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:25.330042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1099/2179] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:25.340998 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:25.342588 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:25.405740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbfa9e-2bf1-49ea-a02e-0ab1e9019eea admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:25.409440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab789f4-c2fd-4bd2-be26-90bf9f1cd416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:25.410090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab789f4-c2fd-4bd2-be26-90bf9f1cd416 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:25.410370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab789f4-c2fd-4bd2-be26-90bf9f1cd416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:25.410644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab789f4-c2fd-4bd2-be26-90bf9f1cd416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:25.421253 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab789f4-c2fd-4bd2-be26-90bf9f1cd416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:25.422735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab789f4-c2fd-4bd2-be26-90bf9f1cd416 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:25.433687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1081/2180] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:41:26.017306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9d355-49c2-4feb-a6f5-4868a692b204 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:26.018771 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-77a9d355-49c2-4feb-a6f5-4868a692b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:26.043063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:26.053720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9d355-49c2-4feb-a6f5-4868a692b204 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:26.058928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:26.060015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:26.060441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:26.060791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] PATH_INFO: `/v3/projects/d713e5cac1824dc69b7b48b4d52e4a73` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:26.062442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d713e5cac1824dc69b7b48b4d52e4a73)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:26.064948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:26.130981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:26.209391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd713e5cac1824dc69b7b48b4d52e4a73', 'request_id': 'req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:26.215221 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd713e5cac1824dc69b7b48b4d52e4a73', 'request_id': 'req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:26.222067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd713e5cac1824dc69b7b48b4d52e4a73', 'request_id': 'req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:26.309133 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] The token cache is being invalidate because project d713e5cac1824dc69b7b48b4d52e4a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:26.309838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:26.310106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:26.311711 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1100/2181] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:26 2022] DELETE /identity/v3/projects/d713e5cac1824dc69b7b48b4d52e4a73 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:26.315941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab789f4-c2fd-4bd2-be26-90bf9f1cd416 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:26.328709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab789f4-c2fd-4bd2-be26-90bf9f1cd416 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:26.389430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:26.390321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:26.390600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:26.390871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] PATH_INFO: `/v3/users/ce532c9ac7864e1ea18ca69508747dc4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:26.392066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce532c9ac7864e1ea18ca69508747dc4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:26.394017 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:26.600375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce532c9ac7864e1ea18ca69508747dc4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:26.616143 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce532c9ac7864e1ea18ca69508747dc4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:26.691700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce532c9ac7864e1ea18ca69508747dc4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:26.692695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce532c9ac7864e1ea18ca69508747dc4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:26.694174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6a640910-06ca-4d15-acd5-b0e871926a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce532c9ac7864e1ea18ca69508747dc4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:26.713361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1082/2182] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:26 2022] DELETE /identity/v3/users/ce532c9ac7864e1ea18ca69508747dc4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:27.120523 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:27.458977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:27.460650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:27.473823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a13b6-3961-4735-96e5-5f94c98f4fe9 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:27.476917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:27.538749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:27.540521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:27.540813 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:27.541089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] PATH_INFO: `/v3/projects/159392c36e1a4e36afdb3847e1fb04a8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:27.542432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] RBAC: Authorizing `identity:delete_project(project_id=159392c36e1a4e36afdb3847e1fb04a8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:27.544379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:27.646420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159392c36e1a4e36afdb3847e1fb04a8', 'request_id': 'req-db5b727d-9984-473b-a4eb-d7b9be7f326f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:27.655511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159392c36e1a4e36afdb3847e1fb04a8', 'request_id': 'req-db5b727d-9984-473b-a4eb-d7b9be7f326f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:27.669703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159392c36e1a4e36afdb3847e1fb04a8', 'request_id': 'req-db5b727d-9984-473b-a4eb-d7b9be7f326f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:27.743343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] The token cache is being invalidate because project 159392c36e1a4e36afdb3847e1fb04a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:27.743692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:27.744384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-db5b727d-9984-473b-a4eb-d7b9be7f326f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:27.746107 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1101/2183] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:27 2022] DELETE /identity/v3/projects/159392c36e1a4e36afdb3847e1fb04a8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:27.751078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e19a8-8492-44c5-8b7f-41fe22f59b6f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:27.751593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e19a8-8492-44c5-8b7f-41fe22f59b6f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:27.751685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e19a8-8492-44c5-8b7f-41fe22f59b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:27.772705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c55e19a8-8492-44c5-8b7f-41fe22f59b6f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:27.774934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c55e19a8-8492-44c5-8b7f-41fe22f59b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:27.859432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1083/2184] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:27.867572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f42eb-0a9b-4200-a942-5478f8ab5fe3 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:27.867848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f42eb-0a9b-4200-a942-5478f8ab5fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:27.868990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f42eb-0a9b-4200-a942-5478f8ab5fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:27.889524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-058f42eb-0a9b-4200-a942-5478f8ab5fe3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:27.891120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-058f42eb-0a9b-4200-a942-5478f8ab5fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:27.903740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1102/2185] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:27.907541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e19a8-8492-44c5-8b7f-41fe22f59b6f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:27.918848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e19a8-8492-44c5-8b7f-41fe22f59b6f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:27.924354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe4f49-8e0f-4693-8842-1eea3c8edafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:27.925287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4f49-8e0f-4693-8842-1eea3c8edafa admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:27.925802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4f49-8e0f-4693-8842-1eea3c8edafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:27.926154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4f49-8e0f-4693-8842-1eea3c8edafa admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:27.927178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe4f49-8e0f-4693-8842-1eea3c8edafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:41:27.927566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe4f49-8e0f-4693-8842-1eea3c8edafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:27.929344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe4f49-8e0f-4693-8842-1eea3c8edafa admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:27.943470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1084/2186] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:41:27.949499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f42eb-0a9b-4200-a942-5478f8ab5fe3 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:27.971129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f42eb-0a9b-4200-a942-5478f8ab5fe3 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:27.977327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd5819-3a87-4391-a58d-2b7349a2e4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:27.977997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd5819-3a87-4391-a58d-2b7349a2e4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:27.978439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd5819-3a87-4391-a58d-2b7349a2e4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:27.979269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd5819-3a87-4391-a58d-2b7349a2e4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:27.980149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd5819-3a87-4391-a58d-2b7349a2e4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:27.982900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd5819-3a87-4391-a58d-2b7349a2e4a7 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:28.089099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1103/2187] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:27 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:28.093172 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe4f49-8e0f-4693-8842-1eea3c8edafa admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:28.109075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe4f49-8e0f-4693-8842-1eea3c8edafa admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:28.203911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2c6e6-7439-4933-8134-ad56f680ea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:28.205894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c6e6-7439-4933-8134-ad56f680ea33 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:28.206361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c6e6-7439-4933-8134-ad56f680ea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:28.206696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c6e6-7439-4933-8134-ad56f680ea33 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:28.210049 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2c6e6-7439-4933-8134-ad56f680ea33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:28.215500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2c6e6-7439-4933-8134-ad56f680ea33 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:28.422733 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:28.441527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1085/2188] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:28 2022] POST /identity/v3/users => generated 292 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:28.446724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd5819-3a87-4391-a58d-2b7349a2e4a7 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:28.468253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd5819-3a87-4391-a58d-2b7349a2e4a7 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:28.495200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdf9e7-10fa-4f63-8aaf-c065734e0094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:28.497247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdf9e7-10fa-4f63-8aaf-c065734e0094 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:28.497716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdf9e7-10fa-4f63-8aaf-c065734e0094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:28.498662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdf9e7-10fa-4f63-8aaf-c065734e0094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:28.500180 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdf9e7-10fa-4f63-8aaf-c065734e0094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:28.503115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdf9e7-10fa-4f63-8aaf-c065734e0094 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:28.516322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1104/2189] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:28.525121 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2c6e6-7439-4933-8134-ad56f680ea33 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:28.537874 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2c6e6-7439-4933-8134-ad56f680ea33 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:28.545881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00c498-6c1f-4f1d-8491-843bfb7603db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:28.546782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00c498-6c1f-4f1d-8491-843bfb7603db admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:28.547337 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00c498-6c1f-4f1d-8491-843bfb7603db admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:28.547709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00c498-6c1f-4f1d-8491-843bfb7603db admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:28.548574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00c498-6c1f-4f1d-8491-843bfb7603db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:28.550810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00c498-6c1f-4f1d-8491-843bfb7603db admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:28.567604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1086/2190] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:41:28.579075 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdf9e7-10fa-4f63-8aaf-c065734e0094 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:28.592584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdf9e7-10fa-4f63-8aaf-c065734e0094 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:28.597336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6019c-fae7-456f-9d04-5f3ae279c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:28.598314 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6019c-fae7-456f-9d04-5f3ae279c90e admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:28.598699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6019c-fae7-456f-9d04-5f3ae279c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:28.599054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6019c-fae7-456f-9d04-5f3ae279c90e admin admin] PATH_INFO: `/v3/projects/370850d875bf41f287f428d0b8d08764/users/900c960d334d490bb7d034666f0d58af/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:28.616287 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6019c-fae7-456f-9d04-5f3ae279c90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=370850d875bf41f287f428d0b8d08764, user_id=900c960d334d490bb7d034666f0d58af, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:28.619725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6019c-fae7-456f-9d04-5f3ae279c90e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:28.721729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1105/2191] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:28 2022] PUT /identity/v3/projects/370850d875bf41f287f428d0b8d08764/users/900c960d334d490bb7d034666f0d58af/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:28.734972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e31f0-ff62-493b-bd4a-422e151baa53 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:28.735328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e31f0-ff62-493b-bd4a-422e151baa53 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:28.735613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e31f0-ff62-493b-bd4a-422e151baa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:28.769784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c10e31f0-ff62-493b-bd4a-422e151baa53 None None] MFA Rules not processed for user `900c960d334d490bb7d034666f0d58af`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:28.771178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c10e31f0-ff62-493b-bd4a-422e151baa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:28.841011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1087/2192] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:28.845609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6019c-fae7-456f-9d04-5f3ae279c90e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:28.910434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6019c-fae7-456f-9d04-5f3ae279c90e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:28.915766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b97865-2961-4d52-8a7f-95eeb86fb73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:28.916459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b97865-2961-4d52-8a7f-95eeb86fb73a admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:28.916748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b97865-2961-4d52-8a7f-95eeb86fb73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:28.917026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b97865-2961-4d52-8a7f-95eeb86fb73a admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:28.917721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b97865-2961-4d52-8a7f-95eeb86fb73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:28.919614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b97865-2961-4d52-8a7f-95eeb86fb73a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:29.184397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1106/2193] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:28 2022] POST /identity/v3/projects => generated 385 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:29.188384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e31f0-ff62-493b-bd4a-422e151baa53 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:29.199309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e31f0-ff62-493b-bd4a-422e151baa53 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:29.258115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e40f9-a060-48b9-bc79-c4d39f519fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:29.259260 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e40f9-a060-48b9-bc79-c4d39f519fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:29.259552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e40f9-a060-48b9-bc79-c4d39f519fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:29.259834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e40f9-a060-48b9-bc79-c4d39f519fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:29.260597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e40f9-a060-48b9-bc79-c4d39f519fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:29.262577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e40f9-a060-48b9-bc79-c4d39f519fa9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:29.355295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1088/2194] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:29 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:29.359242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b97865-2961-4d52-8a7f-95eeb86fb73a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:29.370381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b97865-2961-4d52-8a7f-95eeb86fb73a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:29.377216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda8cca-a282-4b31-b563-a7a2718289f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:29.377216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8cca-a282-4b31-b563-a7a2718289f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:29.377216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8cca-a282-4b31-b563-a7a2718289f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:29.377216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8cca-a282-4b31-b563-a7a2718289f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:29.377929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda8cca-a282-4b31-b563-a7a2718289f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:29.388780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda8cca-a282-4b31-b563-a7a2718289f7 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:29.391557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1107/2195] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:29.395054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e40f9-a060-48b9-bc79-c4d39f519fa9 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:29.406759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e40f9-a060-48b9-bc79-c4d39f519fa9 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:29.411718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb9607-78d2-4b87-9ca4-eb623bf09b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:29.412656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb9607-78d2-4b87-9ca4-eb623bf09b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:29.412942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb9607-78d2-4b87-9ca4-eb623bf09b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:29.413219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb9607-78d2-4b87-9ca4-eb623bf09b13 admin admin] PATH_INFO: `/v3/projects/d1ff5edfa5fc4973a6e3e60d7aae8b30/users/765d9feaccb54835b8868cefefc1c285/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:29.430121 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb9607-78d2-4b87-9ca4-eb623bf09b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ff5edfa5fc4973a6e3e60d7aae8b30, user_id=765d9feaccb54835b8868cefefc1c285, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:29.439690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb9607-78d2-4b87-9ca4-eb623bf09b13 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:29.446234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:29.565025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1089/2196] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:29 2022] PUT /identity/v3/projects/d1ff5edfa5fc4973a6e3e60d7aae8b30/users/765d9feaccb54835b8868cefefc1c285/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:29.573800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda8cca-a282-4b31-b563-a7a2718289f7 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:29.600166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda8cca-a282-4b31-b563-a7a2718289f7 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:29.642922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867e26c-47ff-4d6d-9d1d-0d1db5ed1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:29.643626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867e26c-47ff-4d6d-9d1d-0d1db5ed1a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:29.643913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867e26c-47ff-4d6d-9d1d-0d1db5ed1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:29.644226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867e26c-47ff-4d6d-9d1d-0d1db5ed1a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:29.644951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867e26c-47ff-4d6d-9d1d-0d1db5ed1a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:29.646650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867e26c-47ff-4d6d-9d1d-0d1db5ed1a98 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:29.659964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1108/2197] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:29.661258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb9607-78d2-4b87-9ca4-eb623bf09b13 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:29.673879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb9607-78d2-4b87-9ca4-eb623bf09b13 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:29.679281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d56c5-e4cb-4610-9736-f8e912f443e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:29.685319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d56c5-e4cb-4610-9736-f8e912f443e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:29.685319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d56c5-e4cb-4610-9736-f8e912f443e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:29.685319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d56c5-e4cb-4610-9736-f8e912f443e0 admin admin] PATH_INFO: `/v3/projects/d1ff5edfa5fc4973a6e3e60d7aae8b30/users/765d9feaccb54835b8868cefefc1c285/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:29.685319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d56c5-e4cb-4610-9736-f8e912f443e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ff5edfa5fc4973a6e3e60d7aae8b30, user_id=765d9feaccb54835b8868cefefc1c285, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:29.686321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d56c5-e4cb-4610-9736-f8e912f443e0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:29.696968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867e26c-47ff-4d6d-9d1d-0d1db5ed1a98 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:29.698686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1090/2198] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:29 2022] PUT /identity/v3/projects/d1ff5edfa5fc4973a6e3e60d7aae8b30/users/765d9feaccb54835b8868cefefc1c285/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:29.698904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0867e26c-47ff-4d6d-9d1d-0d1db5ed1a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:29.709391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6c2a-b6c2-4cbd-8473-9dda170c6437 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:29.709925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6c2a-b6c2-4cbd-8473-9dda170c6437 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:29.710423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6c2a-b6c2-4cbd-8473-9dda170c6437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:29.713434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867e26c-47ff-4d6d-9d1d-0d1db5ed1a98 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:29.743448 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-718f6c2a-b6c2-4cbd-8473-9dda170c6437 None None] MFA Rules not processed for user `765d9feaccb54835b8868cefefc1c285`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:29.744849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-718f6c2a-b6c2-4cbd-8473-9dda170c6437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:29.791549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:29.793106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:29.793585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:29.793878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] PATH_INFO: `/v3/users/8ce7a97f83bc44f9bf7d6540d02881b3` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:29.795166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce7a97f83bc44f9bf7d6540d02881b3)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:29.798515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:29.836308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1091/2199] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:29.846903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f6c2a-b6c2-4cbd-8473-9dda170c6437 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:29.848995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-718f6c2a-b6c2-4cbd-8473-9dda170c6437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:29.930975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f6c2a-b6c2-4cbd-8473-9dda170c6437 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:29.936263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144e6bf-bda5-4646-8e70-0291ac4c7809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:29.940634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144e6bf-bda5-4646-8e70-0291ac4c7809 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:29.940634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144e6bf-bda5-4646-8e70-0291ac4c7809 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:29.940634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144e6bf-bda5-4646-8e70-0291ac4c7809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:30.009564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144e6bf-bda5-4646-8e70-0291ac4c7809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:30.011000 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144e6bf-bda5-4646-8e70-0291ac4c7809 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:30.020486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1092/2200] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:41:30.126521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce7a97f83bc44f9bf7d6540d02881b3'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:30.143716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce7a97f83bc44f9bf7d6540d02881b3'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:30.216892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce7a97f83bc44f9bf7d6540d02881b3'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:30.217704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce7a97f83bc44f9bf7d6540d02881b3'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:30.218588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce7a97f83bc44f9bf7d6540d02881b3'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:30.234473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1109/2201] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:29 2022] DELETE /identity/v3/users/8ce7a97f83bc44f9bf7d6540d02881b3 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:41:30.239084 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a6297-c1ae-4ee6-9959-4466db712b5e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:30.239369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a6297-c1ae-4ee6-9959-4466db712b5e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:30.239652 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a6297-c1ae-4ee6-9959-4466db712b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:30.258092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fa6a6297-c1ae-4ee6-9959-4466db712b5e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:30.259452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fa6a6297-c1ae-4ee6-9959-4466db712b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:30.333653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1093/2202] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:41:30.344270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:30.345751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:30.428742 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082b23d-0427-4d5b-8a2f-1aa4975605c3 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:30.433521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340a2de-441c-493f-96c0-fa8c16c48e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:30.434323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340a2de-441c-493f-96c0-fa8c16c48e1f service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:30.434674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340a2de-441c-493f-96c0-fa8c16c48e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:30.434978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340a2de-441c-493f-96c0-fa8c16c48e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:30.445187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340a2de-441c-493f-96c0-fa8c16c48e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:30.446915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340a2de-441c-493f-96c0-fa8c16c48e1f service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:30.461768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1110/2203] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:30.625346 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65390efa-08bc-423e-85ca-19ad7636f4f0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:30.631001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65390efa-08bc-423e-85ca-19ad7636f4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:30.631001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65390efa-08bc-423e-85ca-19ad7636f4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:30.651802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-65390efa-08bc-423e-85ca-19ad7636f4f0 None None] MFA Rules not processed for user `2ab213d4944042199ee9405ed9366c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:30.653113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-65390efa-08bc-423e-85ca-19ad7636f4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:30.737475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1094/2204] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:30.795541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:30.863489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:31.063776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340a2de-441c-493f-96c0-fa8c16c48e1f service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:31.073194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e340a2de-441c-493f-96c0-fa8c16c48e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:31.095112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340a2de-441c-493f-96c0-fa8c16c48e1f service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:31.102223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:31.103389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:31.104016 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:31.104492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] PATH_INFO: `/v3/projects/d762d64492a842b4ba0df30bb4747ae6` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:31.106285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d762d64492a842b4ba0df30bb4747ae6)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:31.108609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:31.264531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd762d64492a842b4ba0df30bb4747ae6', 'request_id': 'req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:31.271101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd762d64492a842b4ba0df30bb4747ae6', 'request_id': 'req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:31.278142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd762d64492a842b4ba0df30bb4747ae6', 'request_id': 'req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:31.396085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] The token cache is being invalidate because project d762d64492a842b4ba0df30bb4747ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:31.397122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:31.397766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:31.399632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1111/2205] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:31 2022] DELETE /identity/v3/projects/d762d64492a842b4ba0df30bb4747ae6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:31.412569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65390efa-08bc-423e-85ca-19ad7636f4f0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:31.415479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-65390efa-08bc-423e-85ca-19ad7636f4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:31.432646 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65390efa-08bc-423e-85ca-19ad7636f4f0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:31.592391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:31.592391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:31.592391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:31.592391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] PATH_INFO: `/v3/users/b51cc916e4264bbdb09eb20f804ee876` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:31.599591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51cc916e4264bbdb09eb20f804ee876)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:31.599591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:31.824450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51cc916e4264bbdb09eb20f804ee876'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:31.836868 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51cc916e4264bbdb09eb20f804ee876'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:31.920052 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51cc916e4264bbdb09eb20f804ee876'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:31.923214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51cc916e4264bbdb09eb20f804ee876'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:31.923214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51cc916e4264bbdb09eb20f804ee876'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:31.935744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1095/2206] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:31 2022] DELETE /identity/v3/users/b51cc916e4264bbdb09eb20f804ee876 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:32.018413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:32.202632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:32.228768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:32.230653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:32.282312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9369132-25ea-4e4e-b3e3-5d98a4d2441a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:32.367992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:32.368956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:32.369404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:32.369673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] PATH_INFO: `/v3/projects/771d3d693cf24a3ea665acbbcd1b94ae` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:32.370907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=771d3d693cf24a3ea665acbbcd1b94ae)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:32.373015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:32.521831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771d3d693cf24a3ea665acbbcd1b94ae', 'request_id': 'req-7c26f0eb-b3ac-4638-8d87-5383cb228681'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:32.531067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771d3d693cf24a3ea665acbbcd1b94ae', 'request_id': 'req-7c26f0eb-b3ac-4638-8d87-5383cb228681'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:32.546135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771d3d693cf24a3ea665acbbcd1b94ae', 'request_id': 'req-7c26f0eb-b3ac-4638-8d87-5383cb228681'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:32.708541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] The token cache is being invalidate because project 771d3d693cf24a3ea665acbbcd1b94ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:32.708848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:32.709633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:32.711903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1112/2207] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:32 2022] DELETE /identity/v3/projects/771d3d693cf24a3ea665acbbcd1b94ae => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:32.716065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:32.717521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:32.731397 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f0c52-7fb4-4b0a-a34a-fdce9c653f6d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:32.791880 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:32.793253 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:32.793542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:32.794637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] PATH_INFO: `/v3/users/8cca91079e684084a2ee22d5130b39a6` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:32.795056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cca91079e684084a2ee22d5130b39a6)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:32.797038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:33.103482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cca91079e684084a2ee22d5130b39a6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:33.119539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cca91079e684084a2ee22d5130b39a6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:33.165932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:33.250828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cca91079e684084a2ee22d5130b39a6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:33.251197 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:33.251653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cca91079e684084a2ee22d5130b39a6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:33.252183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d287ee89-7193-457e-b209-7f08bb9a7949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cca91079e684084a2ee22d5130b39a6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:33.264970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1096/2208] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:32 2022] DELETE /identity/v3/users/8cca91079e684084a2ee22d5130b39a6 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:33.581346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:33.583444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:33.599296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f0eb-b3ac-4638-8d87-5383cb228681 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:33.678485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:33.679445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:33.679727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:33.683435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] PATH_INFO: `/v3/projects/4ed5e923497f42c3ade5cd9f849f737e` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:33.683435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed5e923497f42c3ade5cd9f849f737e)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:33.683766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:33.824225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed5e923497f42c3ade5cd9f849f737e', 'request_id': 'req-e50d2592-3577-4456-9453-a54a61f4f9ed'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:33.829502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed5e923497f42c3ade5cd9f849f737e', 'request_id': 'req-e50d2592-3577-4456-9453-a54a61f4f9ed'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:33.835940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed5e923497f42c3ade5cd9f849f737e', 'request_id': 'req-e50d2592-3577-4456-9453-a54a61f4f9ed'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:34.000056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:34.046811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] The token cache is being invalidate because project 4ed5e923497f42c3ade5cd9f849f737e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:34.048916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:34.048916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-e50d2592-3577-4456-9453-a54a61f4f9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:34.052857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1113/2209] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:33 2022] DELETE /identity/v3/projects/4ed5e923497f42c3ade5cd9f849f737e => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:34.052857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:34.056242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a53a4e-4872-407e-9677-048ddcbbbe00 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:34.056560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a53a4e-4872-407e-9677-048ddcbbbe00 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:34.057734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a53a4e-4872-407e-9677-048ddcbbbe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:34.079340 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-79a53a4e-4872-407e-9677-048ddcbbbe00 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:34.080552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-79a53a4e-4872-407e-9677-048ddcbbbe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:34.140875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1097/2210] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:34.149365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35fff1-adf6-466a-9f8c-a9444e57ac2c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:34.149667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35fff1-adf6-466a-9f8c-a9444e57ac2c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:34.149926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35fff1-adf6-466a-9f8c-a9444e57ac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:34.168085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-7d35fff1-adf6-466a-9f8c-a9444e57ac2c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:34.169300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7d35fff1-adf6-466a-9f8c-a9444e57ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:34.177171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1114/2211] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:34.181459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a53a4e-4872-407e-9677-048ddcbbbe00 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:34.191136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a53a4e-4872-407e-9677-048ddcbbbe00 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:34.196561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebefb4f-72e7-4e55-9ac8-e82cc58a2963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:34.197208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebefb4f-72e7-4e55-9ac8-e82cc58a2963 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:34.197490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebefb4f-72e7-4e55-9ac8-e82cc58a2963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:34.197761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebefb4f-72e7-4e55-9ac8-e82cc58a2963 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:34.198684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebefb4f-72e7-4e55-9ac8-e82cc58a2963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:41:34.198993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebefb4f-72e7-4e55-9ac8-e82cc58a2963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:34.200609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebefb4f-72e7-4e55-9ac8-e82cc58a2963 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:34.212391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1098/2212] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:41:34.217164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35fff1-adf6-466a-9f8c-a9444e57ac2c None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:34.226820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35fff1-adf6-466a-9f8c-a9444e57ac2c None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:34.233120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d2f97-2fe3-442e-b637-1b0b5cb2824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:34.233792 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2f97-2fe3-442e-b637-1b0b5cb2824e admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:34.234105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2f97-2fe3-442e-b637-1b0b5cb2824e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:34.234388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2f97-2fe3-442e-b637-1b0b5cb2824e admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:34.235078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d2f97-2fe3-442e-b637-1b0b5cb2824e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:34.237100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d2f97-2fe3-442e-b637-1b0b5cb2824e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:34.413005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1115/2213] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:34 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:34.417819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebefb4f-72e7-4e55-9ac8-e82cc58a2963 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:34.427885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebefb4f-72e7-4e55-9ac8-e82cc58a2963 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:34.495886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb868c-86a1-4691-b28d-25d85df50d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:34.496610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb868c-86a1-4691-b28d-25d85df50d5d admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:34.496879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb868c-86a1-4691-b28d-25d85df50d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:34.497156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb868c-86a1-4691-b28d-25d85df50d5d admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:34.497835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb868c-86a1-4691-b28d-25d85df50d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:34.499737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb868c-86a1-4691-b28d-25d85df50d5d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:34.638452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1099/2214] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:34 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:34.639554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d2f97-2fe3-442e-b637-1b0b5cb2824e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:34.651090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d2f97-2fe3-442e-b637-1b0b5cb2824e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:34.656224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e4390-07f7-4735-97a6-aeafc30d6de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:34.657016 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e4390-07f7-4735-97a6-aeafc30d6de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:34.657429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e4390-07f7-4735-97a6-aeafc30d6de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:34.657810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e4390-07f7-4735-97a6-aeafc30d6de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:34.659073 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e4390-07f7-4735-97a6-aeafc30d6de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:34.660682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e4390-07f7-4735-97a6-aeafc30d6de3 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:34.677647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1116/2215] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:41:34.681447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb868c-86a1-4691-b28d-25d85df50d5d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:34.693999 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb868c-86a1-4691-b28d-25d85df50d5d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:34.703344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83178a6-3aad-4858-9669-36b51cf3e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:34.706772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83178a6-3aad-4858-9669-36b51cf3e6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:34.706772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83178a6-3aad-4858-9669-36b51cf3e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:34.706772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83178a6-3aad-4858-9669-36b51cf3e6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:34.706772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83178a6-3aad-4858-9669-36b51cf3e6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:34.707615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83178a6-3aad-4858-9669-36b51cf3e6c0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:34.718862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1100/2216] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:34.723060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e4390-07f7-4735-97a6-aeafc30d6de3 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:34.734574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e4390-07f7-4735-97a6-aeafc30d6de3 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:34.752857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857f55a-0d80-4684-bf65-a0bb4906bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:34.752857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857f55a-0d80-4684-bf65-a0bb4906bec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:34.752857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857f55a-0d80-4684-bf65-a0bb4906bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:34.752857 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857f55a-0d80-4684-bf65-a0bb4906bec4 admin admin] PATH_INFO: `/v3/projects/189828bd62784b50b3bcb89dc6194fb6/users/f4f653e8b62e40cbb437a7a2f7f3461c/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:34.756491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857f55a-0d80-4684-bf65-a0bb4906bec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189828bd62784b50b3bcb89dc6194fb6, user_id=f4f653e8b62e40cbb437a7a2f7f3461c, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:34.759427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857f55a-0d80-4684-bf65-a0bb4906bec4 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:34.978078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1117/2217] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:34 2022] PUT /identity/v3/projects/189828bd62784b50b3bcb89dc6194fb6/users/f4f653e8b62e40cbb437a7a2f7f3461c/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:34.988801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8754447-64a4-46a3-984b-37b3a0ed6395 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:34.989102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8754447-64a4-46a3-984b-37b3a0ed6395 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:34.989385 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8754447-64a4-46a3-984b-37b3a0ed6395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:35.018058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e8754447-64a4-46a3-984b-37b3a0ed6395 None None] MFA Rules not processed for user `f4f653e8b62e40cbb437a7a2f7f3461c`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:35.019290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e8754447-64a4-46a3-984b-37b3a0ed6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:35.092805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1101/2218] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:35.106227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857f55a-0d80-4684-bf65-a0bb4906bec4 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:35.108050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3857f55a-0d80-4684-bf65-a0bb4906bec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:35.167916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857f55a-0d80-4684-bf65-a0bb4906bec4 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:35.171522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba9eda-854a-46a3-85c7-4e386d4c52e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:35.172234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9eda-854a-46a3-85c7-4e386d4c52e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:35.172528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9eda-854a-46a3-85c7-4e386d4c52e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:35.172806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9eda-854a-46a3-85c7-4e386d4c52e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:35.181298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba9eda-854a-46a3-85c7-4e386d4c52e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:35.182725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba9eda-854a-46a3-85c7-4e386d4c52e7 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:35.191584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1118/2219] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:35.211729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8754447-64a4-46a3-984b-37b3a0ed6395 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:35.275611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:35.288040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8754447-64a4-46a3-984b-37b3a0ed6395 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:35.288224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:35.289920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:35.290207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:35.291363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] PATH_INFO: `/v3/users/f4f653e8b62e40cbb437a7a2f7f3461c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:35.291816 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f653e8b62e40cbb437a7a2f7f3461c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:35.293815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:35.565841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:35.603455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f653e8b62e40cbb437a7a2f7f3461c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:35.615393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f653e8b62e40cbb437a7a2f7f3461c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:35.708743 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f653e8b62e40cbb437a7a2f7f3461c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:35.709458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f653e8b62e40cbb437a7a2f7f3461c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:35.710079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f653e8b62e40cbb437a7a2f7f3461c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:35.727050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1102/2220] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:35 2022] DELETE /identity/v3/users/f4f653e8b62e40cbb437a7a2f7f3461c => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:35.729007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230ddc-1e71-458e-93b3-ac01de5d249c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:35.729321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230ddc-1e71-458e-93b3-ac01de5d249c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:35.729672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230ddc-1e71-458e-93b3-ac01de5d249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:35.749560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-eb230ddc-1e71-458e-93b3-ac01de5d249c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:35.750780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-eb230ddc-1e71-458e-93b3-ac01de5d249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:35.826760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1119/2221] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:35.848245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:35.848245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:35.905382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93834ea3-cf91-4dc0-9735-57e2145b1de0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:35.911893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a0059-6378-4cb9-a6a4-be1ba20e84fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:35.912589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a0059-6378-4cb9-a6a4-be1ba20e84fd service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:35.912875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a0059-6378-4cb9-a6a4-be1ba20e84fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:35.913327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a0059-6378-4cb9-a6a4-be1ba20e84fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:35.923043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a0059-6378-4cb9-a6a4-be1ba20e84fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:35.924769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a0059-6378-4cb9-a6a4-be1ba20e84fd service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:35.933212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:35.943091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1103/2222] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:36.262907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:36.564597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230ddc-1e71-458e-93b3-ac01de5d249c None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:36.564597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-eb230ddc-1e71-458e-93b3-ac01de5d249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:36.576737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230ddc-1e71-458e-93b3-ac01de5d249c None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:36.582555 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:36.583725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:36.583957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:36.584270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] PATH_INFO: `/v3/projects/189828bd62784b50b3bcb89dc6194fb6` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:36.585994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=189828bd62784b50b3bcb89dc6194fb6)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:36.588390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:36.772443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189828bd62784b50b3bcb89dc6194fb6', 'request_id': 'req-4f031955-5c07-4efe-91b4-8e79866d5d2a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:36.780105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189828bd62784b50b3bcb89dc6194fb6', 'request_id': 'req-4f031955-5c07-4efe-91b4-8e79866d5d2a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:36.786653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189828bd62784b50b3bcb89dc6194fb6', 'request_id': 'req-4f031955-5c07-4efe-91b4-8e79866d5d2a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:36.796587 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:36.868981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] The token cache is being invalidate because project 189828bd62784b50b3bcb89dc6194fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:36.869280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:36.872508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4f031955-5c07-4efe-91b4-8e79866d5d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:36.872508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1120/2223] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:36 2022] DELETE /identity/v3/projects/189828bd62784b50b3bcb89dc6194fb6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:36.876460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d1d91-b8f4-45e9-add9-cc86c584f581 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:36.876935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d1d91-b8f4-45e9-add9-cc86c584f581 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:36.877226 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d1d91-b8f4-45e9-add9-cc86c584f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:36.897744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-878d1d91-b8f4-45e9-add9-cc86c584f581 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:36.899593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-878d1d91-b8f4-45e9-add9-cc86c584f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:36.961495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1104/2224] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:36.970447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80109d-511f-4a1b-ba8a-387b764c1ebd None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:36.970739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80109d-511f-4a1b-ba8a-387b764c1ebd None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:36.974526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80109d-511f-4a1b-ba8a-387b764c1ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:36.990108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-be80109d-511f-4a1b-ba8a-387b764c1ebd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:36.991323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-be80109d-511f-4a1b-ba8a-387b764c1ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:36.999624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1121/2225] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:37.009012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d1d91-b8f4-45e9-add9-cc86c584f581 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:37.015141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d1d91-b8f4-45e9-add9-cc86c584f581 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:37.019830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6c445-5271-4473-ac40-24962d358d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:37.020612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6c445-5271-4473-ac40-24962d358d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:37.020906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6c445-5271-4473-ac40-24962d358d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:37.021164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6c445-5271-4473-ac40-24962d358d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:37.021967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6c445-5271-4473-ac40-24962d358d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:41:37.022272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6c445-5271-4473-ac40-24962d358d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:37.024685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6c445-5271-4473-ac40-24962d358d9a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:37.036997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1105/2226] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:41:37.041606 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80109d-511f-4a1b-ba8a-387b764c1ebd None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:37.051554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80109d-511f-4a1b-ba8a-387b764c1ebd None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:37.056536 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d84c1-d36c-468a-811d-7dc5adb06189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:37.057234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d84c1-d36c-468a-811d-7dc5adb06189 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:37.057524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d84c1-d36c-468a-811d-7dc5adb06189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:37.057803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d84c1-d36c-468a-811d-7dc5adb06189 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:37.058500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d84c1-d36c-468a-811d-7dc5adb06189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:37.060482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d84c1-d36c-468a-811d-7dc5adb06189 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:37.190261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1122/2227] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:37 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:41:37.194386 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6c445-5271-4473-ac40-24962d358d9a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:37.205715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6c445-5271-4473-ac40-24962d358d9a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:37.292959 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c42ae8-eded-489a-aba3-f5e454f55459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:37.293735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c42ae8-eded-489a-aba3-f5e454f55459 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:37.294096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c42ae8-eded-489a-aba3-f5e454f55459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:37.294453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c42ae8-eded-489a-aba3-f5e454f55459 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:37.296647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c42ae8-eded-489a-aba3-f5e454f55459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:37.301620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c42ae8-eded-489a-aba3-f5e454f55459 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:37.406001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1106/2228] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:37 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:41:37.410339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d84c1-d36c-468a-811d-7dc5adb06189 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:37.422071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d84c1-d36c-468a-811d-7dc5adb06189 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:37.427216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bde621-d8bc-4b8b-a048-a9b84a50578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:37.427893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bde621-d8bc-4b8b-a048-a9b84a50578d admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:37.428282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bde621-d8bc-4b8b-a048-a9b84a50578d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:37.429285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bde621-d8bc-4b8b-a048-a9b84a50578d admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:37.430713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bde621-d8bc-4b8b-a048-a9b84a50578d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:37.432507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bde621-d8bc-4b8b-a048-a9b84a50578d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:37.446692 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:37.447807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1123/2229] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:41:37.450290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c42ae8-eded-489a-aba3-f5e454f55459 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:37.462002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c42ae8-eded-489a-aba3-f5e454f55459 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:37.467120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a011074-3e9b-45fa-a7d1-61a92bb1e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:37.467917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a011074-3e9b-45fa-a7d1-61a92bb1e958 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:37.468299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a011074-3e9b-45fa-a7d1-61a92bb1e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:37.468652 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a011074-3e9b-45fa-a7d1-61a92bb1e958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:37.469390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a011074-3e9b-45fa-a7d1-61a92bb1e958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:37.470999 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a011074-3e9b-45fa-a7d1-61a92bb1e958 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:37.482350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1107/2230] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:37.486681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bde621-d8bc-4b8b-a048-a9b84a50578d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:37.497927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bde621-d8bc-4b8b-a048-a9b84a50578d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:37.503765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579385f7-78dd-4eae-8f18-ed5be1d6e559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:37.504759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579385f7-78dd-4eae-8f18-ed5be1d6e559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:37.505400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579385f7-78dd-4eae-8f18-ed5be1d6e559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:37.505789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579385f7-78dd-4eae-8f18-ed5be1d6e559 admin admin] PATH_INFO: `/v3/projects/4070b09cad8240cd855b9421e6cde735/users/8e73ab3d4fa54b84ad3386daede9f63a/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:37.525002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579385f7-78dd-4eae-8f18-ed5be1d6e559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4070b09cad8240cd855b9421e6cde735, user_id=8e73ab3d4fa54b84ad3386daede9f63a, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:37.527622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579385f7-78dd-4eae-8f18-ed5be1d6e559 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:37.611014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1124/2231] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:37 2022] PUT /identity/v3/projects/4070b09cad8240cd855b9421e6cde735/users/8e73ab3d4fa54b84ad3386daede9f63a/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:37.622112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555cfc8-992d-4cc4-876b-fc6485b60164 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:37.622406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555cfc8-992d-4cc4-876b-fc6485b60164 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:37.622693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555cfc8-992d-4cc4-876b-fc6485b60164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:37.650383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b555cfc8-992d-4cc4-876b-fc6485b60164 None None] MFA Rules not processed for user `8e73ab3d4fa54b84ad3386daede9f63a`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:37.651592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b555cfc8-992d-4cc4-876b-fc6485b60164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:37.716876 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1108/2232] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:37.734308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579385f7-78dd-4eae-8f18-ed5be1d6e559 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:37.736039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-579385f7-78dd-4eae-8f18-ed5be1d6e559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:37.806389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579385f7-78dd-4eae-8f18-ed5be1d6e559 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:37.810292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1262a-3f2d-4721-bef9-f1ba9562e705 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff915d0b23d4b9ebd70e6b6b885aca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:37.810869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1262a-3f2d-4721-bef9-f1ba9562e705 service glance] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:37.811185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1262a-3f2d-4721-bef9-f1ba9562e705 service glance] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:37.811466 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1262a-3f2d-4721-bef9-f1ba9562e705 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:37.820567 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1262a-3f2d-4721-bef9-f1ba9562e705 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:37.822025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1262a-3f2d-4721-bef9-f1ba9562e705 service glance] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:37.830985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1125/2233] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:38.125425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:38.467897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:38.932491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555cfc8-992d-4cc4-876b-fc6485b60164 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:38.934110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b555cfc8-992d-4cc4-876b-fc6485b60164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:39.011529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555cfc8-992d-4cc4-876b-fc6485b60164 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:39.015152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2204dab-d37b-437d-902f-aab9d4230d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:39.015800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2204dab-d37b-437d-902f-aab9d4230d8d service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:39.016098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2204dab-d37b-437d-902f-aab9d4230d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:39.016428 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2204dab-d37b-437d-902f-aab9d4230d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:39.018202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f2204dab-d37b-437d-902f-aab9d4230d8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:39.081534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2204dab-d37b-437d-902f-aab9d4230d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:39.083293 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2204dab-d37b-437d-902f-aab9d4230d8d service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:39.095043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1109/2234] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:46.685062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1262a-3f2d-4721-bef9-f1ba9562e705 service glance] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:46.686640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f3b1262a-3f2d-4721-bef9-f1ba9562e705 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:46.754831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1262a-3f2d-4721-bef9-f1ba9562e705 service glance] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:46.759413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:46.760314 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:46.760601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:46.760876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] PATH_INFO: `/v3/users/900c960d334d490bb7d034666f0d58af` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:46.762072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900c960d334d490bb7d034666f0d58af)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:46.764012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:47.045676 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:47.055315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900c960d334d490bb7d034666f0d58af'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:47.068194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900c960d334d490bb7d034666f0d58af'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:47.159414 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900c960d334d490bb7d034666f0d58af'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:47.160247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900c960d334d490bb7d034666f0d58af'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:47.164727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900c960d334d490bb7d034666f0d58af'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:47.175390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1126/2235] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:46 2022] DELETE /identity/v3/users/900c960d334d490bb7d034666f0d58af => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:47.180593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462af63-2628-4d1c-9871-cf3c1b45b61a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:47.181087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462af63-2628-4d1c-9871-cf3c1b45b61a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:47.181169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462af63-2628-4d1c-9871-cf3c1b45b61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:47.198987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5462af63-2628-4d1c-9871-cf3c1b45b61a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:47.200232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5462af63-2628-4d1c-9871-cf3c1b45b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:47.258074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:47.268041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1110/2236] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:47.281654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:47.285189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:47.348324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454df09-8e67-4a99-8592-776b4d4303a3 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:47.352128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05ff18-cd05-4e83-a099-27d9463273bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:47.352718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05ff18-cd05-4e83-a099-27d9463273bf service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:47.353012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05ff18-cd05-4e83-a099-27d9463273bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:47.353277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05ff18-cd05-4e83-a099-27d9463273bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:47.363720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05ff18-cd05-4e83-a099-27d9463273bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:47.365350 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05ff18-cd05-4e83-a099-27d9463273bf service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:47.378709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1127/2237] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:48.024207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462af63-2628-4d1c-9871-cf3c1b45b61a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:48.025697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5462af63-2628-4d1c-9871-cf3c1b45b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:48.038121 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462af63-2628-4d1c-9871-cf3c1b45b61a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:48.043010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:48.043895 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:48.044210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:48.044485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] PATH_INFO: `/v3/projects/370850d875bf41f287f428d0b8d08764` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:48.045751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=370850d875bf41f287f428d0b8d08764)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:48.047668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:48.197863 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '370850d875bf41f287f428d0b8d08764', 'request_id': 'req-6d2adfd2-965e-42bc-8c34-cf8509154e53'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:48.204046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '370850d875bf41f287f428d0b8d08764', 'request_id': 'req-6d2adfd2-965e-42bc-8c34-cf8509154e53'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:48.325715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '370850d875bf41f287f428d0b8d08764', 'request_id': 'req-6d2adfd2-965e-42bc-8c34-cf8509154e53'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:48.345622 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] The token cache is being invalidate because project 370850d875bf41f287f428d0b8d08764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:48.352641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:48.352641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:48.352641 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1111/2238] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:48 2022] DELETE /identity/v3/projects/370850d875bf41f287f428d0b8d08764 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:48.353761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05ff18-cd05-4e83-a099-27d9463273bf service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:48.364285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05ff18-cd05-4e83-a099-27d9463273bf service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:48.423784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:48.424727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:48.425012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:48.425290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] PATH_INFO: `/v3/users/765d9feaccb54835b8868cefefc1c285` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:48.426476 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765d9feaccb54835b8868cefefc1c285)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:48.429132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:48.613005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765d9feaccb54835b8868cefefc1c285'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:48.621101 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:48.626156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765d9feaccb54835b8868cefefc1c285'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:48.708973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765d9feaccb54835b8868cefefc1c285'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:48.709621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765d9feaccb54835b8868cefefc1c285'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:48.710772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4b4b7087-38a4-4d41-8526-24f21b5cfe56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765d9feaccb54835b8868cefefc1c285'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:48.724749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1128/2239] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:48 2022] DELETE /identity/v3/users/765d9feaccb54835b8868cefefc1c285 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:49.410215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:49.411881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:49.427739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2adfd2-965e-42bc-8c34-cf8509154e53 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:49.499040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:49.500048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:49.500419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:49.500785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] PATH_INFO: `/v3/projects/d1ff5edfa5fc4973a6e3e60d7aae8b30` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:49.502096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ff5edfa5fc4973a6e3e60d7aae8b30)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:49.504765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:49.675255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ff5edfa5fc4973a6e3e60d7aae8b30', 'request_id': 'req-b416e122-b673-4e2c-bb3f-24e0accb1adf'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:49.682444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ff5edfa5fc4973a6e3e60d7aae8b30', 'request_id': 'req-b416e122-b673-4e2c-bb3f-24e0accb1adf'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:49.782405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ff5edfa5fc4973a6e3e60d7aae8b30', 'request_id': 'req-b416e122-b673-4e2c-bb3f-24e0accb1adf'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:49.796220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] The token cache is being invalidate because project d1ff5edfa5fc4973a6e3e60d7aae8b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:49.796512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:49.797356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b416e122-b673-4e2c-bb3f-24e0accb1adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:49.799025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1112/2240] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:49 2022] DELETE /identity/v3/projects/d1ff5edfa5fc4973a6e3e60d7aae8b30 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:49.805977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e41c60-49df-4a28-9f7b-f284bbe9d56e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:49.806501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e41c60-49df-4a28-9f7b-f284bbe9d56e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:49.806603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e41c60-49df-4a28-9f7b-f284bbe9d56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:49.826448 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a9e41c60-49df-4a28-9f7b-f284bbe9d56e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:49.827686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a9e41c60-49df-4a28-9f7b-f284bbe9d56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:49.892316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1129/2241] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:49.902454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60469fb-d475-43ec-a049-9ae22192f9b4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:49.902795 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60469fb-d475-43ec-a049-9ae22192f9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:49.903076 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60469fb-d475-43ec-a049-9ae22192f9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:49.926175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f60469fb-d475-43ec-a049-9ae22192f9b4 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:49.927653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f60469fb-d475-43ec-a049-9ae22192f9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:49.937410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1113/2242] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:49.941330 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e41c60-49df-4a28-9f7b-f284bbe9d56e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:49.952166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e41c60-49df-4a28-9f7b-f284bbe9d56e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:49.961702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e80ba-747b-47c0-9110-5484e1e087e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:49.961702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e80ba-747b-47c0-9110-5484e1e087e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:49.961702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e80ba-747b-47c0-9110-5484e1e087e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:49.961702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e80ba-747b-47c0-9110-5484e1e087e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:49.962115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e80ba-747b-47c0-9110-5484e1e087e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:41:49.962115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e80ba-747b-47c0-9110-5484e1e087e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:49.962947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e80ba-747b-47c0-9110-5484e1e087e8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:49.976581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1130/2243] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:41:49.988954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60469fb-d475-43ec-a049-9ae22192f9b4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:49.999547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60469fb-d475-43ec-a049-9ae22192f9b4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:50.004815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce34eb-1806-4c98-9f6f-b95ad22646c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:50.005572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce34eb-1806-4c98-9f6f-b95ad22646c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:50.005924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce34eb-1806-4c98-9f6f-b95ad22646c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:50.006271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce34eb-1806-4c98-9f6f-b95ad22646c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:50.008210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce34eb-1806-4c98-9f6f-b95ad22646c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:50.010181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce34eb-1806-4c98-9f6f-b95ad22646c7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:50.013915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:50.166940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1114/2244] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:49 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:50.174097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e80ba-747b-47c0-9110-5484e1e087e8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:50.185205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e80ba-747b-47c0-9110-5484e1e087e8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:50.249051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c020fa-58ec-4e25-938c-aa3b2632edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:50.249730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c020fa-58ec-4e25-938c-aa3b2632edef admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:50.250018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c020fa-58ec-4e25-938c-aa3b2632edef admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:50.250297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c020fa-58ec-4e25-938c-aa3b2632edef admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:50.250994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c020fa-58ec-4e25-938c-aa3b2632edef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:50.252949 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c020fa-58ec-4e25-938c-aa3b2632edef admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:50.326014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1131/2245] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:50 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:50.330266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce34eb-1806-4c98-9f6f-b95ad22646c7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:50.341565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce34eb-1806-4c98-9f6f-b95ad22646c7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:50.346223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400b7b6-5e58-4fc6-b787-b466101635c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:50.346876 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400b7b6-5e58-4fc6-b787-b466101635c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:50.347157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400b7b6-5e58-4fc6-b787-b466101635c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:50.347430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400b7b6-5e58-4fc6-b787-b466101635c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:50.348174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400b7b6-5e58-4fc6-b787-b466101635c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:50.349778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400b7b6-5e58-4fc6-b787-b466101635c0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:50.360691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1115/2246] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:50.364797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c020fa-58ec-4e25-938c-aa3b2632edef admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:50.376106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c020fa-58ec-4e25-938c-aa3b2632edef admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:50.381026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301c7e2-1aba-4d7d-a467-c9ab1fd21861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:50.382744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c7e2-1aba-4d7d-a467-c9ab1fd21861 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:50.383058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c7e2-1aba-4d7d-a467-c9ab1fd21861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:50.383343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301c7e2-1aba-4d7d-a467-c9ab1fd21861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:50.384089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301c7e2-1aba-4d7d-a467-c9ab1fd21861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:50.385729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301c7e2-1aba-4d7d-a467-c9ab1fd21861 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:50.396367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1132/2247] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:50.401193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400b7b6-5e58-4fc6-b787-b466101635c0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:50.411618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400b7b6-5e58-4fc6-b787-b466101635c0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:50.416754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de874d-9e55-401b-a4c9-2106328f19e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:50.417650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de874d-9e55-401b-a4c9-2106328f19e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:50.417930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de874d-9e55-401b-a4c9-2106328f19e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:50.422035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de874d-9e55-401b-a4c9-2106328f19e0 admin admin] PATH_INFO: `/v3/projects/b0feeba7af4744198c3168611771e713/users/9b073c1f1b244596a2d5a4b86b901eda/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:50.433342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de874d-9e55-401b-a4c9-2106328f19e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0feeba7af4744198c3168611771e713, user_id=9b073c1f1b244596a2d5a4b86b901eda, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:50.435920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de874d-9e55-401b-a4c9-2106328f19e0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:50.565483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1116/2248] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:50 2022] PUT /identity/v3/projects/b0feeba7af4744198c3168611771e713/users/9b073c1f1b244596a2d5a4b86b901eda/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:50.577441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c53c-0148-435c-8e8d-3a4f6a0a48e6 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:50.578257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c53c-0148-435c-8e8d-3a4f6a0a48e6 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:50.578548 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c53c-0148-435c-8e8d-3a4f6a0a48e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:50.615930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4b74c53c-0148-435c-8e8d-3a4f6a0a48e6 None None] MFA Rules not processed for user `9b073c1f1b244596a2d5a4b86b901eda`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:50.617234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4b74c53c-0148-435c-8e8d-3a4f6a0a48e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:50.674031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:50.724216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1133/2249] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:50.741680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de874d-9e55-401b-a4c9-2106328f19e0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:50.744369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-51de874d-9e55-401b-a4c9-2106328f19e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:50.806863 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de874d-9e55-401b-a4c9-2106328f19e0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:50.810871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ca91d-e9e8-4f7d-9efa-c4e972df7e5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:50.811681 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ca91d-e9e8-4f7d-9efa-c4e972df7e5b service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:50.816872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ca91d-e9e8-4f7d-9efa-c4e972df7e5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:50.816872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ca91d-e9e8-4f7d-9efa-c4e972df7e5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:50.821600 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ca91d-e9e8-4f7d-9efa-c4e972df7e5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:50.823035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ca91d-e9e8-4f7d-9efa-c4e972df7e5b service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:50.833034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1117/2250] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:53.139143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74c53c-0148-435c-8e8d-3a4f6a0a48e6 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:53.140659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4b74c53c-0148-435c-8e8d-3a4f6a0a48e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:53.212525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74c53c-0148-435c-8e8d-3a4f6a0a48e6 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:53.217270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:53.218354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:53.218638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:53.218912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] PATH_INFO: `/v3/users/c6fe7c0a86dc477a99cfc7d5065dfb19` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:53.220118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fe7c0a86dc477a99cfc7d5065dfb19)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:53.222030 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:53.539491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fe7c0a86dc477a99cfc7d5065dfb19'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:53.552679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fe7c0a86dc477a99cfc7d5065dfb19'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:53.627902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fe7c0a86dc477a99cfc7d5065dfb19'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:53.628568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fe7c0a86dc477a99cfc7d5065dfb19'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:53.629205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fe7c0a86dc477a99cfc7d5065dfb19'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:53.644568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1134/2251] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:41:53 2022] DELETE /identity/v3/users/c6fe7c0a86dc477a99cfc7d5065dfb19 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:53.650072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee3a83-f11f-429d-9f84-5475e0408899 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:53.650570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee3a83-f11f-429d-9f84-5475e0408899 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:53.650672 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee3a83-f11f-429d-9f84-5475e0408899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:53.668840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c5ee3a83-f11f-429d-9f84-5475e0408899 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:53.669981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c5ee3a83-f11f-429d-9f84-5475e0408899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:53.734741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1118/2252] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:53.745759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:53.747209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:53.815433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23ae15-a662-4e97-af67-ed0d5ca29bfa admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:53.819958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7906a-2dab-40b1-bcd8-584f88f841db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:53.820834 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7906a-2dab-40b1-bcd8-584f88f841db service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:53.821120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7906a-2dab-40b1-bcd8-584f88f841db service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:53.821401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7906a-2dab-40b1-bcd8-584f88f841db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:53.827777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:53.832427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7906a-2dab-40b1-bcd8-584f88f841db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:53.834176 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7906a-2dab-40b1-bcd8-584f88f841db service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:53.845823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1135/2253] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:41:54.339896 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee3a83-f11f-429d-9f84-5475e0408899 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:54.341212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c5ee3a83-f11f-429d-9f84-5475e0408899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:54.359103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee3a83-f11f-429d-9f84-5475e0408899 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:54.378591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:54.379443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:54.379728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:54.380008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] PATH_INFO: `/v3/projects/f76b1075f4754bf9a04b994ccfb7f3de` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:54.381575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76b1075f4754bf9a04b994ccfb7f3de)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:54.384269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:54.533747 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:54.534989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76b1075f4754bf9a04b994ccfb7f3de', 'request_id': 'req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:54.541825 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76b1075f4754bf9a04b994ccfb7f3de', 'request_id': 'req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:54.661873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76b1075f4754bf9a04b994ccfb7f3de', 'request_id': 'req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:54.674713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] The token cache is being invalidate because project f76b1075f4754bf9a04b994ccfb7f3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:41:54.674994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:54.675655 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4191e516-e2c7-4538-9ff9-ff7eeddb1e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:41:54.677220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1119/2254] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:41:54 2022] DELETE /identity/v3/projects/f76b1075f4754bf9a04b994ccfb7f3de => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:54.685902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017a46a-a59e-4b3f-bc4b-cd03b847249b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:54.685902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017a46a-a59e-4b3f-bc4b-cd03b847249b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:54.685902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017a46a-a59e-4b3f-bc4b-cd03b847249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:54.703011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-1017a46a-a59e-4b3f-bc4b-cd03b847249b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:54.704312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-1017a46a-a59e-4b3f-bc4b-cd03b847249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:54.765464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1136/2255] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:54.773976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea454b-62a1-49ed-9f30-0b85134033b8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:54.774265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea454b-62a1-49ed-9f30-0b85134033b8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:54.774547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea454b-62a1-49ed-9f30-0b85134033b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:54.793678 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f3ea454b-62a1-49ed-9f30-0b85134033b8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:54.794888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f3ea454b-62a1-49ed-9f30-0b85134033b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:54.802779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1120/2256] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:54.807594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017a46a-a59e-4b3f-bc4b-cd03b847249b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:54.817448 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017a46a-a59e-4b3f-bc4b-cd03b847249b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:54.822427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db75ea9-a153-44d1-bb5a-779a79355bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:54.823118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db75ea9-a153-44d1-bb5a-779a79355bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:54.823403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db75ea9-a153-44d1-bb5a-779a79355bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:54.823679 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db75ea9-a153-44d1-bb5a-779a79355bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:54.824452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db75ea9-a153-44d1-bb5a-779a79355bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:41:54.824765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db75ea9-a153-44d1-bb5a-779a79355bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:54.829600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db75ea9-a153-44d1-bb5a-779a79355bcf admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:54.844765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1137/2257] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:41:54.846090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea454b-62a1-49ed-9f30-0b85134033b8 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:54.856555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea454b-62a1-49ed-9f30-0b85134033b8 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:54.861246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6a56-433c-4629-8692-3aca28fb894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:54.861894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6a56-433c-4629-8692-3aca28fb894b admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:54.862173 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6a56-433c-4629-8692-3aca28fb894b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:54.862444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6a56-433c-4629-8692-3aca28fb894b admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:54.863125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6a56-433c-4629-8692-3aca28fb894b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:54.865139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6a56-433c-4629-8692-3aca28fb894b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:54.990640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1121/2258] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:41:54 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:54.994121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db75ea9-a153-44d1-bb5a-779a79355bcf admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:55.004416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db75ea9-a153-44d1-bb5a-779a79355bcf admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:55.065938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40881c99-a48d-41b8-870a-ec57a882b398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:55.066627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40881c99-a48d-41b8-870a-ec57a882b398 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:55.066913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40881c99-a48d-41b8-870a-ec57a882b398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:55.067188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40881c99-a48d-41b8-870a-ec57a882b398 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:55.067942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40881c99-a48d-41b8-870a-ec57a882b398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:55.071464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40881c99-a48d-41b8-870a-ec57a882b398 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:55.207539 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1138/2259] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:41:54 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:41:55.212425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6a56-433c-4629-8692-3aca28fb894b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:55.223559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6a56-433c-4629-8692-3aca28fb894b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:55.228950 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4240ce-6417-491b-a161-3ffaa4d3a940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:55.229645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4240ce-6417-491b-a161-3ffaa4d3a940 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:55.229930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4240ce-6417-491b-a161-3ffaa4d3a940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:55.230208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4240ce-6417-491b-a161-3ffaa4d3a940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:55.230950 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4240ce-6417-491b-a161-3ffaa4d3a940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:55.232645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4240ce-6417-491b-a161-3ffaa4d3a940 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:55.244421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1122/2260] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:55.248493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40881c99-a48d-41b8-870a-ec57a882b398 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:55.260508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40881c99-a48d-41b8-870a-ec57a882b398 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:55.265179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47efa8-1847-489a-bfaa-455e3d9ac8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:55.265837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47efa8-1847-489a-bfaa-455e3d9ac8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:55.266152 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47efa8-1847-489a-bfaa-455e3d9ac8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:55.266431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47efa8-1847-489a-bfaa-455e3d9ac8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:55.267155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47efa8-1847-489a-bfaa-455e3d9ac8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:55.268799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47efa8-1847-489a-bfaa-455e3d9ac8f6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:55.279465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1139/2261] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:41:55.283613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4240ce-6417-491b-a161-3ffaa4d3a940 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:55.293804 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4240ce-6417-491b-a161-3ffaa4d3a940 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:55.298389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a920ec-5ca7-4c7e-974c-5de8a4a89c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:55.299267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a920ec-5ca7-4c7e-974c-5de8a4a89c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:55.299589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a920ec-5ca7-4c7e-974c-5de8a4a89c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:55.299861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a920ec-5ca7-4c7e-974c-5de8a4a89c45 admin admin] PATH_INFO: `/v3/projects/1c0d4324288e41c4ab5c4b24a7f3cfbd/users/b26d3bc7b17b4ec79a6bff51ccdf1bee/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:55.315384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a920ec-5ca7-4c7e-974c-5de8a4a89c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0d4324288e41c4ab5c4b24a7f3cfbd, user_id=b26d3bc7b17b4ec79a6bff51ccdf1bee, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:55.318149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a920ec-5ca7-4c7e-974c-5de8a4a89c45 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:55.405495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1123/2262] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:41:55 2022] PUT /identity/v3/projects/1c0d4324288e41c4ab5c4b24a7f3cfbd/users/b26d3bc7b17b4ec79a6bff51ccdf1bee/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:41:55.413933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0bce-de49-435b-b06b-3eed3a5913e2 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:55.413933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0bce-de49-435b-b06b-3eed3a5913e2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:55.413933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0bce-de49-435b-b06b-3eed3a5913e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:55.430311 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-843d0bce-de49-435b-b06b-3eed3a5913e2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:41:55.431518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-843d0bce-de49-435b-b06b-3eed3a5913e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:55.483165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:55.493158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1140/2263] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:41:55.509456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a920ec-5ca7-4c7e-974c-5de8a4a89c45 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:41:55.511239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c8a920ec-5ca7-4c7e-974c-5de8a4a89c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:41:55.578662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a920ec-5ca7-4c7e-974c-5de8a4a89c45 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:41:55.583552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226bf15-5ba7-476c-9c6b-5f37a6feefa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:41:55.584366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226bf15-5ba7-476c-9c6b-5f37a6feefa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:41:55.584799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226bf15-5ba7-476c-9c6b-5f37a6feefa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:41:55.585190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226bf15-5ba7-476c-9c6b-5f37a6feefa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:41:55.595404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226bf15-5ba7-476c-9c6b-5f37a6feefa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:41:55.596890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226bf15-5ba7-476c-9c6b-5f37a6feefa5 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:41:55.611591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1124/2264] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:00.705118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0bce-de49-435b-b06b-3eed3a5913e2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:00.705118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-843d0bce-de49-435b-b06b-3eed3a5913e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:00.716982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0bce-de49-435b-b06b-3eed3a5913e2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:00.723224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:00.724429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:00.724575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:00.724792 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] PATH_INFO: `/v3/users/9b073c1f1b244596a2d5a4b86b901eda` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:00.726997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b073c1f1b244596a2d5a4b86b901eda)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:00.729040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:01.049021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b073c1f1b244596a2d5a4b86b901eda'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:01.068247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b073c1f1b244596a2d5a4b86b901eda'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:01.270562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b073c1f1b244596a2d5a4b86b901eda'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:01.271269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b073c1f1b244596a2d5a4b86b901eda'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:01.272704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-f2a91872-aae8-4e39-80a6-b7db9f13bd2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b073c1f1b244596a2d5a4b86b901eda'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:01.297510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1141/2265] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:42:00 2022] DELETE /identity/v3/users/9b073c1f1b244596a2d5a4b86b901eda => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:01.301731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7856655-fcbb-4994-b67e-9d3acb72dd10 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:01.302246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a697-5d76-4b88-aee7-293c7eb8a2e2 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:01.302246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a697-5d76-4b88-aee7-293c7eb8a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:01.303168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a697-5d76-4b88-aee7-293c7eb8a2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:01.303848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7856655-fcbb-4994-b67e-9d3acb72dd10 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:01.304427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7856655-fcbb-4994-b67e-9d3acb72dd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:01.337583 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-c260a697-5d76-4b88-aee7-293c7eb8a2e2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:01.339237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c260a697-5d76-4b88-aee7-293c7eb8a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:01.403691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a7856655-fcbb-4994-b67e-9d3acb72dd10 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:01.406175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a7856655-fcbb-4994-b67e-9d3acb72dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:01.459959 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:01.461427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1142/2266] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:42:01.512230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1125/2267] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:42:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:01.537131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260a697-5d76-4b88-aee7-293c7eb8a2e2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:01.539685 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c260a697-5d76-4b88-aee7-293c7eb8a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:01.567068 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7856655-fcbb-4994-b67e-9d3acb72dd10 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:01.568530 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a7856655-fcbb-4994-b67e-9d3acb72dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:01.662709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260a697-5d76-4b88-aee7-293c7eb8a2e2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:01.672063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cc0c7-7ce6-4dc3-8307-e85d35d6f5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:01.673442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc0c7-7ce6-4dc3-8307-e85d35d6f5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:01.673442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc0c7-7ce6-4dc3-8307-e85d35d6f5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:01.673442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc0c7-7ce6-4dc3-8307-e85d35d6f5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:01.699634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cc0c7-7ce6-4dc3-8307-e85d35d6f5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:01.701698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cc0c7-7ce6-4dc3-8307-e85d35d6f5e7 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:01.724789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1143/2268] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:01.754151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7856655-fcbb-4994-b67e-9d3acb72dd10 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:01.761254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f784e0-c3bd-4ce5-b15e-3a5822b830c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:01.762397 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f784e0-c3bd-4ce5-b15e-3a5822b830c1 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:01.762787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f784e0-c3bd-4ce5-b15e-3a5822b830c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:01.763169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f784e0-c3bd-4ce5-b15e-3a5822b830c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:01.774832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f784e0-c3bd-4ce5-b15e-3a5822b830c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:01.777055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f784e0-c3bd-4ce5-b15e-3a5822b830c1 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:01.799192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1126/2269] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 17:42:01.889083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f23023-1742-4be9-a078-d520279dd97a None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:01.889440 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f23023-1742-4be9-a078-d520279dd97a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:01.889652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f23023-1742-4be9-a078-d520279dd97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:01.924690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-34f23023-1742-4be9-a078-d520279dd97a None None] MFA Rules not processed for user `f814a06f54894fa2992d3ba3be21b4db`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:01.928386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-34f23023-1742-4be9-a078-d520279dd97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:01.949973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:02.010851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1144/2270] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:02.517902 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f784e0-c3bd-4ce5-b15e-3a5822b830c1 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:02.522278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b9f784e0-c3bd-4ce5-b15e-3a5822b830c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:02.579885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f784e0-c3bd-4ce5-b15e-3a5822b830c1 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:02.594933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:02.600562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:02.600562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:02.601040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] PATH_INFO: `/v3/projects/b0feeba7af4744198c3168611771e713` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:02.604445 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0feeba7af4744198c3168611771e713)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:02.637069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:02.865050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0feeba7af4744198c3168611771e713', 'request_id': 'req-6c773940-6b0c-4025-9378-25b0f14381a7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:02.883290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0feeba7af4744198c3168611771e713', 'request_id': 'req-6c773940-6b0c-4025-9378-25b0f14381a7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:03.025840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0feeba7af4744198c3168611771e713', 'request_id': 'req-6c773940-6b0c-4025-9378-25b0f14381a7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:03.043259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] The token cache is being invalidate because project b0feeba7af4744198c3168611771e713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:42:03.043549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:03.044244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c773940-6b0c-4025-9378-25b0f14381a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:03.046101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1127/2271] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:42:02 2022] DELETE /identity/v3/projects/b0feeba7af4744198c3168611771e713 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:03.051456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43780996-8e0c-49a5-b068-969da5a9bea1 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:03.052402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43780996-8e0c-49a5-b068-969da5a9bea1 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:03.054375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43780996-8e0c-49a5-b068-969da5a9bea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:03.088368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-43780996-8e0c-49a5-b068-969da5a9bea1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:03.091370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-43780996-8e0c-49a5-b068-969da5a9bea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:03.176995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1145/2272] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:03.184887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801715-f856-44a3-a01e-6f1b9fb3446e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:03.185181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801715-f856-44a3-a01e-6f1b9fb3446e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:03.186386 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801715-f856-44a3-a01e-6f1b9fb3446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:03.316871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dc826-87c7-42d5-9cb4-8f24af1357aa None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:03.316871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dc826-87c7-42d5-9cb4-8f24af1357aa None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:03.316871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dc826-87c7-42d5-9cb4-8f24af1357aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:03.318011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-71801715-f856-44a3-a01e-6f1b9fb3446e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:03.318011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-71801715-f856-44a3-a01e-6f1b9fb3446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:03.318450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-864dc826-87c7-42d5-9cb4-8f24af1357aa None None] MFA Rules not processed for user `b26d3bc7b17b4ec79a6bff51ccdf1bee`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:03.318450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-864dc826-87c7-42d5-9cb4-8f24af1357aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:03.347899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1128/2273] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:03.347899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801715-f856-44a3-a01e-6f1b9fb3446e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:03.358006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801715-f856-44a3-a01e-6f1b9fb3446e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:03.378845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8013a4-7b53-49fe-a29e-d032d3442e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:03.378845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8013a4-7b53-49fe-a29e-d032d3442e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:03.378845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8013a4-7b53-49fe-a29e-d032d3442e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:03.378845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8013a4-7b53-49fe-a29e-d032d3442e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:03.380621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8013a4-7b53-49fe-a29e-d032d3442e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:42:03.380621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8013a4-7b53-49fe-a29e-d032d3442e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:03.380621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8013a4-7b53-49fe-a29e-d032d3442e3d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:03.422826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1129/2274] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:42:03.423785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8013a4-7b53-49fe-a29e-d032d3442e3d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:03.435299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:03.450372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8013a4-7b53-49fe-a29e-d032d3442e3d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:03.458786 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff79cf-2fdb-4be9-8fec-6e6843eb2169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:03.460033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff79cf-2fdb-4be9-8fec-6e6843eb2169 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:03.460322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff79cf-2fdb-4be9-8fec-6e6843eb2169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:03.460607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff79cf-2fdb-4be9-8fec-6e6843eb2169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:03.461394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff79cf-2fdb-4be9-8fec-6e6843eb2169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:03.463298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff79cf-2fdb-4be9-8fec-6e6843eb2169 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:03.528159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1146/2275] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:03.532554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dc826-87c7-42d5-9cb4-8f24af1357aa None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:03.534731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-864dc826-87c7-42d5-9cb4-8f24af1357aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:03.578559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dc826-87c7-42d5-9cb4-8f24af1357aa None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:03.590182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e433ac-8113-4ccc-9863-c5270f93a684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:03.590182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e433ac-8113-4ccc-9863-c5270f93a684 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:03.591889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e433ac-8113-4ccc-9863-c5270f93a684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:03.592345 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e433ac-8113-4ccc-9863-c5270f93a684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:03.593291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e433ac-8113-4ccc-9863-c5270f93a684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:03.595954 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e433ac-8113-4ccc-9863-c5270f93a684 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:03.866201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1130/2276] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:42:03 2022] POST /identity/v3/projects => generated 361 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:42:03.870338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff79cf-2fdb-4be9-8fec-6e6843eb2169 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:03.889057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1147/2277] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:42:03 2022] POST /identity/v3/projects => generated 383 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:42:03.890040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e433ac-8113-4ccc-9863-c5270f93a684 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:04.058531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:04.103125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff79cf-2fdb-4be9-8fec-6e6843eb2169 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:04.186307 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e433ac-8113-4ccc-9863-c5270f93a684 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:04.200378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846769eb-5140-4e75-8a9d-c7e22967ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:04.201092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846769eb-5140-4e75-8a9d-c7e22967ee2d admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:04.201379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846769eb-5140-4e75-8a9d-c7e22967ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:04.201659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846769eb-5140-4e75-8a9d-c7e22967ee2d admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:04.202418 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846769eb-5140-4e75-8a9d-c7e22967ee2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:04.204466 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846769eb-5140-4e75-8a9d-c7e22967ee2d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:04.288930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e3caa-f82c-49f1-96b1-58e5ca9a5fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:04.302190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e3caa-f82c-49f1-96b1-58e5ca9a5fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:04.302190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e3caa-f82c-49f1-96b1-58e5ca9a5fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:04.302190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e3caa-f82c-49f1-96b1-58e5ca9a5fcb admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:04.302190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e3caa-f82c-49f1-96b1-58e5ca9a5fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:04.305409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e3caa-f82c-49f1-96b1-58e5ca9a5fcb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:04.338750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1148/2278] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:42:03 2022] POST /identity/v3/users => generated 298 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:42:04.341629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846769eb-5140-4e75-8a9d-c7e22967ee2d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:04.379402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846769eb-5140-4e75-8a9d-c7e22967ee2d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:04.395749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbe292-fc79-4d12-af93-68ae4e597d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:04.397011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe292-fc79-4d12-af93-68ae4e597d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:04.397852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe292-fc79-4d12-af93-68ae4e597d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:04.398641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe292-fc79-4d12-af93-68ae4e597d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:04.399763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbe292-fc79-4d12-af93-68ae4e597d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:04.402527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbe292-fc79-4d12-af93-68ae4e597d0a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:04.422025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1149/2279] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:04.424217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1131/2280] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:42:03 2022] POST /identity/v3/users => generated 281 bytes in 554 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:42:04.425408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e3caa-f82c-49f1-96b1-58e5ca9a5fcb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:04.426498 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbe292-fc79-4d12-af93-68ae4e597d0a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:04.443413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbe292-fc79-4d12-af93-68ae4e597d0a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:04.465079 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8aa00-7b72-4c3a-ae87-e9fd275d2c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:04.469327 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8aa00-7b72-4c3a-ae87-e9fd275d2c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:04.477959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8aa00-7b72-4c3a-ae87-e9fd275d2c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:04.477959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8aa00-7b72-4c3a-ae87-e9fd275d2c70 admin admin] PATH_INFO: `/v3/projects/40097c6e5e334edeb86d2e50fbdf9933/users/4ff783fe5acd4ba485061cfb681db34f/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:04.485208 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e3caa-f82c-49f1-96b1-58e5ca9a5fcb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:04.494416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b494767-c4cf-44c1-a6b5-12a6d2cbaf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:04.495679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b494767-c4cf-44c1-a6b5-12a6d2cbaf76 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:04.496493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b494767-c4cf-44c1-a6b5-12a6d2cbaf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:04.496798 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b494767-c4cf-44c1-a6b5-12a6d2cbaf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:04.497533 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b494767-c4cf-44c1-a6b5-12a6d2cbaf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:04.499664 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b494767-c4cf-44c1-a6b5-12a6d2cbaf76 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:04.526255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1132/2281] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:04.527374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b494767-c4cf-44c1-a6b5-12a6d2cbaf76 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:04.529436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8aa00-7b72-4c3a-ae87-e9fd275d2c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40097c6e5e334edeb86d2e50fbdf9933, user_id=4ff783fe5acd4ba485061cfb681db34f, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:04.539287 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8aa00-7b72-4c3a-ae87-e9fd275d2c70 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:04.541452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b494767-c4cf-44c1-a6b5-12a6d2cbaf76 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:04.554538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa925c9-a4a5-4bdb-931c-85a3c0e51565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:04.557367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa925c9-a4a5-4bdb-931c-85a3c0e51565 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:04.557657 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa925c9-a4a5-4bdb-931c-85a3c0e51565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:04.557975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa925c9-a4a5-4bdb-931c-85a3c0e51565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:04.558679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa925c9-a4a5-4bdb-931c-85a3c0e51565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:04.560311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa925c9-a4a5-4bdb-931c-85a3c0e51565 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:04.606533 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1133/2282] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:04.607837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa925c9-a4a5-4bdb-931c-85a3c0e51565 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:04.635769 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa925c9-a4a5-4bdb-931c-85a3c0e51565 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:04.642343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e836331-40c3-4c74-9d2a-590757bac77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:04.643785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e836331-40c3-4c74-9d2a-590757bac77f admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:04.644749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e836331-40c3-4c74-9d2a-590757bac77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:04.645104 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e836331-40c3-4c74-9d2a-590757bac77f admin admin] PATH_INFO: `/v3/projects/f335d018c7284f96996489611cdde363/users/17678947f29d4c86987ac74e9beb5387/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:04.665668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e836331-40c3-4c74-9d2a-590757bac77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f335d018c7284f96996489611cdde363, user_id=17678947f29d4c86987ac74e9beb5387, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:04.668235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e836331-40c3-4c74-9d2a-590757bac77f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:04.686558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1150/2283] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:42:04 2022] PUT /identity/v3/projects/40097c6e5e334edeb86d2e50fbdf9933/users/4ff783fe5acd4ba485061cfb681db34f/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:04.690376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8aa00-7b72-4c3a-ae87-e9fd275d2c70 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:04.768227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8aa00-7b72-4c3a-ae87-e9fd275d2c70 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:04.773826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f4e1b-47cf-426a-b686-e163a0672279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:04.774710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4e1b-47cf-426a-b686-e163a0672279 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:04.776976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4e1b-47cf-426a-b686-e163a0672279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:04.776976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4e1b-47cf-426a-b686-e163a0672279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:04.776976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f4e1b-47cf-426a-b686-e163a0672279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:04.780830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f4e1b-47cf-426a-b686-e163a0672279 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:04.792851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1151/2284] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:04.794040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1134/2285] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:42:04 2022] PUT /identity/v3/projects/f335d018c7284f96996489611cdde363/users/17678947f29d4c86987ac74e9beb5387/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:04.796600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f4e1b-47cf-426a-b686-e163a0672279 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:04.811018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f4e1b-47cf-426a-b686-e163a0672279 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:04.813174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246e85-365c-4d31-b395-ea0043c6688a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:04.813666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246e85-365c-4d31-b395-ea0043c6688a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:04.814153 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246e85-365c-4d31-b395-ea0043c6688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:04.873886 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ec246e85-365c-4d31-b395-ea0043c6688a None None] MFA Rules not processed for user `17678947f29d4c86987ac74e9beb5387`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:04.875099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ec246e85-365c-4d31-b395-ea0043c6688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:04.896045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61e29-67f3-4dea-9131-772e64603c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:04.897250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61e29-67f3-4dea-9131-772e64603c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:04.897626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61e29-67f3-4dea-9131-772e64603c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:04.897998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61e29-67f3-4dea-9131-772e64603c3d admin admin] PATH_INFO: `/v3/projects/40097c6e5e334edeb86d2e50fbdf9933/users/4ff783fe5acd4ba485061cfb681db34f/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:04.900633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a61e29-67f3-4dea-9131-772e64603c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40097c6e5e334edeb86d2e50fbdf9933, user_id=4ff783fe5acd4ba485061cfb681db34f, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:04.904486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a61e29-67f3-4dea-9131-772e64603c3d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:04.910246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:04.918517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1152/2286] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:42:04 2022] PUT /identity/v3/projects/40097c6e5e334edeb86d2e50fbdf9933/users/4ff783fe5acd4ba485061cfb681db34f/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:04.978011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1135/2287] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:05.015149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61e29-67f3-4dea-9131-772e64603c3d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:05.017072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f9a61e29-67f3-4dea-9131-772e64603c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:05.032654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:05.089553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61e29-67f3-4dea-9131-772e64603c3d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:05.091821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1207b07-d562-4318-a0a0-33910e479ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:05.092594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207b07-d562-4318-a0a0-33910e479ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:05.092885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207b07-d562-4318-a0a0-33910e479ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:05.093163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207b07-d562-4318-a0a0-33910e479ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:05.187924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1207b07-d562-4318-a0a0-33910e479ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:05.189668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1207b07-d562-4318-a0a0-33910e479ca6 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:05.201215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1153/2288] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:05.220811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec246e85-365c-4d31-b395-ea0043c6688a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:05.234987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec246e85-365c-4d31-b395-ea0043c6688a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:05.345574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:05.352843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:05.352843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:05.352843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] PATH_INFO: `/v3/users/17678947f29d4c86987ac74e9beb5387` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:05.353776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17678947f29d4c86987ac74e9beb5387)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:05.356176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:05.523985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17678947f29d4c86987ac74e9beb5387'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:05.543325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17678947f29d4c86987ac74e9beb5387'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:05.710415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17678947f29d4c86987ac74e9beb5387'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:05.711135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17678947f29d4c86987ac74e9beb5387'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:05.712162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17678947f29d4c86987ac74e9beb5387'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:05.739933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1136/2289] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:42:05 2022] DELETE /identity/v3/users/17678947f29d4c86987ac74e9beb5387 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:05.742805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10b722-13c2-4511-a675-1854953eb312 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:05.743543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10b722-13c2-4511-a675-1854953eb312 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:05.743543 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10b722-13c2-4511-a675-1854953eb312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:05.772994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4e10b722-13c2-4511-a675-1854953eb312 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:05.775353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4e10b722-13c2-4511-a675-1854953eb312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:05.904639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1154/2290] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:05.915100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:05.916772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:06.065074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:06.091796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131f2a9-f244-4a50-9511-a476e0c1a273 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:06.104898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adf0b6-c384-44db-b304-6687826e3eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:06.104898 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf0b6-c384-44db-b304-6687826e3eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:06.105174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf0b6-c384-44db-b304-6687826e3eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:06.105779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf0b6-c384-44db-b304-6687826e3eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:06.133288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adf0b6-c384-44db-b304-6687826e3eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:06.138838 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adf0b6-c384-44db-b304-6687826e3eb2 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:06.168411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1137/2291] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:07.034063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10b722-13c2-4511-a675-1854953eb312 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:07.035865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4e10b722-13c2-4511-a675-1854953eb312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:07.081056 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10b722-13c2-4511-a675-1854953eb312 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:07.091956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:07.094159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:07.094159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:07.094739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] PATH_INFO: `/v3/projects/f335d018c7284f96996489611cdde363` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:07.097764 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f335d018c7284f96996489611cdde363)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:07.101382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:07.397926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f335d018c7284f96996489611cdde363', 'request_id': 'req-b99910a9-2a1c-443c-bda1-1bb2837f2e62'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:07.410262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f335d018c7284f96996489611cdde363', 'request_id': 'req-b99910a9-2a1c-443c-bda1-1bb2837f2e62'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:07.427263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f335d018c7284f96996489611cdde363', 'request_id': 'req-b99910a9-2a1c-443c-bda1-1bb2837f2e62'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:07.432593 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:07.499797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] The token cache is being invalidate because project f335d018c7284f96996489611cdde363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:42:07.500013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:07.500628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:07.503456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1155/2292] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:42:07 2022] DELETE /identity/v3/projects/f335d018c7284f96996489611cdde363 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:07.510150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd084b-1a50-4873-b90f-9945b5cbaecb None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:07.511118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd084b-1a50-4873-b90f-9945b5cbaecb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:07.511634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd084b-1a50-4873-b90f-9945b5cbaecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:07.589265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a3cd084b-1a50-4873-b90f-9945b5cbaecb None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:07.590901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a3cd084b-1a50-4873-b90f-9945b5cbaecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:07.692087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:07.693091 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:07.931384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1138/2293] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:07.937591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19851ad-55b1-410a-87c4-cf3a634d89b4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:07.937800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19851ad-55b1-410a-87c4-cf3a634d89b4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:07.938082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19851ad-55b1-410a-87c4-cf3a634d89b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:07.968326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99910a9-2a1c-443c-bda1-1bb2837f2e62 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:07.986429 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:07.993762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:07.994054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:07.994337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] PATH_INFO: `/v3/users/8e73ab3d4fa54b84ad3386daede9f63a` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:07.995931 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a19851ad-55b1-410a-87c4-cf3a634d89b4 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:07.997204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a19851ad-55b1-410a-87c4-cf3a634d89b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:07.998744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e73ab3d4fa54b84ad3386daede9f63a)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:08.000744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:08.023911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1139/2294] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:08.026007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19851ad-55b1-410a-87c4-cf3a634d89b4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:08.039483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19851ad-55b1-410a-87c4-cf3a634d89b4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:08.050135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242a179-f6ad-430b-8df2-b20861ab9329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:08.050508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242a179-f6ad-430b-8df2-b20861ab9329 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:08.051507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242a179-f6ad-430b-8df2-b20861ab9329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:08.052066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242a179-f6ad-430b-8df2-b20861ab9329 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:08.053687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242a179-f6ad-430b-8df2-b20861ab9329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:42:08.054517 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242a179-f6ad-430b-8df2-b20861ab9329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:08.058316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242a179-f6ad-430b-8df2-b20861ab9329 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:08.093168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1140/2295] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:42:08.095702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242a179-f6ad-430b-8df2-b20861ab9329 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:08.130015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242a179-f6ad-430b-8df2-b20861ab9329 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:08.141442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f12100-b9e2-487a-abe0-93cbce3250aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:08.141939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f12100-b9e2-487a-abe0-93cbce3250aa admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:08.142209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f12100-b9e2-487a-abe0-93cbce3250aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:08.142489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f12100-b9e2-487a-abe0-93cbce3250aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:08.143241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f12100-b9e2-487a-abe0-93cbce3250aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:08.154015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f12100-b9e2-487a-abe0-93cbce3250aa admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:08.320005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e73ab3d4fa54b84ad3386daede9f63a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:08.342986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1141/2296] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:42:08 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:42:08.344531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f12100-b9e2-487a-abe0-93cbce3250aa admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:08.354131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e73ab3d4fa54b84ad3386daede9f63a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:08.438903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e73ab3d4fa54b84ad3386daede9f63a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:08.439536 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e73ab3d4fa54b84ad3386daede9f63a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:08.440217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3f0683a5-80cf-4f1c-93d6-c1f4b1d2f307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e73ab3d4fa54b84ad3386daede9f63a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:08.471755 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1156/2297] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:42:07 2022] DELETE /identity/v3/users/8e73ab3d4fa54b84ad3386daede9f63a => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:08.477206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e053ce-8b8a-4396-83fc-03db5aa69d40 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:08.477571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e053ce-8b8a-4396-83fc-03db5aa69d40 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:08.477912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e053ce-8b8a-4396-83fc-03db5aa69d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:08.528974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a2e053ce-8b8a-4396-83fc-03db5aa69d40 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:08.530582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a2e053ce-8b8a-4396-83fc-03db5aa69d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:08.547706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f12100-b9e2-487a-abe0-93cbce3250aa admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:08.713839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:08.718837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1157/2298] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:42:08.745581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6506f2-6b8e-4e7d-8f21-533047dd094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:08.746088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6506f2-6b8e-4e7d-8f21-533047dd094f admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:08.746432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6506f2-6b8e-4e7d-8f21-533047dd094f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:08.746713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6506f2-6b8e-4e7d-8f21-533047dd094f admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:08.747468 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6506f2-6b8e-4e7d-8f21-533047dd094f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:08.751686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e053ce-8b8a-4396-83fc-03db5aa69d40 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:08.753703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a2e053ce-8b8a-4396-83fc-03db5aa69d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:08.762685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6506f2-6b8e-4e7d-8f21-533047dd094f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:08.805273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:08.929002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e053ce-8b8a-4396-83fc-03db5aa69d40 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:08.941674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1142/2299] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:42:08 2022] POST /identity/v3/users => generated 288 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:42:08.943147 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6506f2-6b8e-4e7d-8f21-533047dd094f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:08.946117 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c092-e470-4a3a-a6d8-b7ec08ea5555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:08.948436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fb6506f2-6b8e-4e7d-8f21-533047dd094f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:08.958669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c092-e470-4a3a-a6d8-b7ec08ea5555 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:08.960210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c092-e470-4a3a-a6d8-b7ec08ea5555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:08.960871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c092-e470-4a3a-a6d8-b7ec08ea5555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:08.982085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6506f2-6b8e-4e7d-8f21-533047dd094f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:08.988719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c092-e470-4a3a-a6d8-b7ec08ea5555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:08.988719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c092-e470-4a3a-a6d8-b7ec08ea5555 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:08.999326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d4ff7-c0c0-4f14-b61c-eb8ce346dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:09.000405 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d4ff7-c0c0-4f14-b61c-eb8ce346dcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:09.000791 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d4ff7-c0c0-4f14-b61c-eb8ce346dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:09.001204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d4ff7-c0c0-4f14-b61c-eb8ce346dcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:09.002071 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d4ff7-c0c0-4f14-b61c-eb8ce346dcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:09.003983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d4ff7-c0c0-4f14-b61c-eb8ce346dcbd admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:09.020858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1158/2300] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:42:09.036563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1143/2301] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:09.039236 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c092-e470-4a3a-a6d8-b7ec08ea5555 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:09.058486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c092-e470-4a3a-a6d8-b7ec08ea5555 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:09.072492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49fa57-1bd4-4a8e-b2af-3fe2da79cb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:09.073364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49fa57-1bd4-4a8e-b2af-3fe2da79cb36 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:09.073755 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49fa57-1bd4-4a8e-b2af-3fe2da79cb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:09.074135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49fa57-1bd4-4a8e-b2af-3fe2da79cb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:09.074982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49fa57-1bd4-4a8e-b2af-3fe2da79cb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:09.077468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49fa57-1bd4-4a8e-b2af-3fe2da79cb36 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:09.110976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1159/2302] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:09.118086 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d4ff7-c0c0-4f14-b61c-eb8ce346dcbd admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:09.134001 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d4ff7-c0c0-4f14-b61c-eb8ce346dcbd admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:09.161937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09b31c-b002-4a09-a5f2-a4d0e7657706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:09.163949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09b31c-b002-4a09-a5f2-a4d0e7657706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:09.164315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09b31c-b002-4a09-a5f2-a4d0e7657706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:09.164656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09b31c-b002-4a09-a5f2-a4d0e7657706 admin admin] PATH_INFO: `/v3/projects/9542aa9a0bc24753847a92923c4fbe08/users/ddf42a1eb96545918038781cebda23ca/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:09.222909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09b31c-b002-4a09-a5f2-a4d0e7657706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9542aa9a0bc24753847a92923c4fbe08, user_id=ddf42a1eb96545918038781cebda23ca, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:09.229811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09b31c-b002-4a09-a5f2-a4d0e7657706 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:09.399519 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1144/2303] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:42:09 2022] PUT /identity/v3/projects/9542aa9a0bc24753847a92923c4fbe08/users/ddf42a1eb96545918038781cebda23ca/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:09.409913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c8433-40e1-400a-9408-e3dd60d79c33 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:09.410815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c8433-40e1-400a-9408-e3dd60d79c33 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:09.411303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c8433-40e1-400a-9408-e3dd60d79c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:09.499143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-864c8433-40e1-400a-9408-e3dd60d79c33 None None] MFA Rules not processed for user `ddf42a1eb96545918038781cebda23ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:09.501502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-864c8433-40e1-400a-9408-e3dd60d79c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:09.666128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1160/2304] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:09.679909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09b31c-b002-4a09-a5f2-a4d0e7657706 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:09.688648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6b09b31c-b002-4a09-a5f2-a4d0e7657706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:09.874194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09b31c-b002-4a09-a5f2-a4d0e7657706 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:09.883422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cb387-43ac-485a-9874-ae015daa8b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:09.891085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cb387-43ac-485a-9874-ae015daa8b95 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:09.891085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cb387-43ac-485a-9874-ae015daa8b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:09.891085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cb387-43ac-485a-9874-ae015daa8b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:09.911091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cb387-43ac-485a-9874-ae015daa8b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:09.913519 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cb387-43ac-485a-9874-ae015daa8b95 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:09.942990 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1145/2305] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:10.683876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c8433-40e1-400a-9408-e3dd60d79c33 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:10.687106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-864c8433-40e1-400a-9408-e3dd60d79c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:10.859157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c8433-40e1-400a-9408-e3dd60d79c33 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:10.865162 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:10.868713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:10.869477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:10.869966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] PATH_INFO: `/v3/projects/4070b09cad8240cd855b9421e6cde735` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:10.871645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4070b09cad8240cd855b9421e6cde735)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:10.874188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:11.073795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:11.107778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4070b09cad8240cd855b9421e6cde735', 'request_id': 'req-9758994a-d537-4818-a3f2-1f2e6d80e99a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:11.122309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4070b09cad8240cd855b9421e6cde735', 'request_id': 'req-9758994a-d537-4818-a3f2-1f2e6d80e99a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:11.132894 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4070b09cad8240cd855b9421e6cde735', 'request_id': 'req-9758994a-d537-4818-a3f2-1f2e6d80e99a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:11.252232 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] The token cache is being invalidate because project 4070b09cad8240cd855b9421e6cde735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:42:11.252818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:11.254880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-9758994a-d537-4818-a3f2-1f2e6d80e99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:11.260344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1161/2306] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:42:10 2022] DELETE /identity/v3/projects/4070b09cad8240cd855b9421e6cde735 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:11.265377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf7453-0a35-4b6a-93c8-0514cf154f0e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:11.265834 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf7453-0a35-4b6a-93c8-0514cf154f0e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:11.266145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf7453-0a35-4b6a-93c8-0514cf154f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:11.301102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f1cf7453-0a35-4b6a-93c8-0514cf154f0e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:11.304650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f1cf7453-0a35-4b6a-93c8-0514cf154f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:11.414823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1146/2307] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:11.422882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97046f-795f-432a-bad9-c49d321c3939 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:11.423328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97046f-795f-432a-bad9-c49d321c3939 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:11.424256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97046f-795f-432a-bad9-c49d321c3939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:11.467972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-8b97046f-795f-432a-bad9-c49d321c3939 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:11.469421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8b97046f-795f-432a-bad9-c49d321c3939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:11.485213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1162/2308] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:11.489328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf7453-0a35-4b6a-93c8-0514cf154f0e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:11.503889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf7453-0a35-4b6a-93c8-0514cf154f0e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:11.512354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec966d-50e3-48f2-a60c-f3f72ca41b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:11.513566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec966d-50e3-48f2-a60c-f3f72ca41b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:11.514050 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec966d-50e3-48f2-a60c-f3f72ca41b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:11.514523 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec966d-50e3-48f2-a60c-f3f72ca41b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:11.515578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec966d-50e3-48f2-a60c-f3f72ca41b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:42:11.516440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec966d-50e3-48f2-a60c-f3f72ca41b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:11.520794 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec966d-50e3-48f2-a60c-f3f72ca41b36 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:11.536563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1147/2309] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:42:11.541342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97046f-795f-432a-bad9-c49d321c3939 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:11.560303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97046f-795f-432a-bad9-c49d321c3939 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:11.575640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9def92-540a-4516-bc1f-69ea5e16eef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:11.577318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9def92-540a-4516-bc1f-69ea5e16eef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:11.577787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9def92-540a-4516-bc1f-69ea5e16eef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:11.578216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9def92-540a-4516-bc1f-69ea5e16eef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:11.579077 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9def92-540a-4516-bc1f-69ea5e16eef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:11.582827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9def92-540a-4516-bc1f-69ea5e16eef4 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:11.726695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1163/2310] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:42:11 2022] POST /identity/v3/projects => generated 369 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:42:11.728668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec966d-50e3-48f2-a60c-f3f72ca41b36 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:11.743356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec966d-50e3-48f2-a60c-f3f72ca41b36 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:11.799446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:11.886327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5915994-cc05-43f7-99b7-71917bbfedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:11.887489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5915994-cc05-43f7-99b7-71917bbfedef admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:11.887892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5915994-cc05-43f7-99b7-71917bbfedef admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:11.888207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5915994-cc05-43f7-99b7-71917bbfedef admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:11.890519 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5915994-cc05-43f7-99b7-71917bbfedef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:11.892518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5915994-cc05-43f7-99b7-71917bbfedef admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:12.042806 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1148/2311] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:42:11 2022] POST /identity/v3/users => generated 285 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:42:12.047012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9def92-540a-4516-bc1f-69ea5e16eef4 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:12.064447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9def92-540a-4516-bc1f-69ea5e16eef4 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:12.077852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba10d33-d894-4209-8d7f-1ca158c80d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:12.078536 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10d33-d894-4209-8d7f-1ca158c80d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:12.078818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10d33-d894-4209-8d7f-1ca158c80d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:12.079092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10d33-d894-4209-8d7f-1ca158c80d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:12.079820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba10d33-d894-4209-8d7f-1ca158c80d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:12.087776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba10d33-d894-4209-8d7f-1ca158c80d45 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:12.111011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1164/2312] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:12.117362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5915994-cc05-43f7-99b7-71917bbfedef admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:12.142949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5915994-cc05-43f7-99b7-71917bbfedef admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:12.159142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f93ccf-158e-46e9-b17e-86dcb35bec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:12.159839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f93ccf-158e-46e9-b17e-86dcb35bec80 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:12.160189 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f93ccf-158e-46e9-b17e-86dcb35bec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:12.160472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f93ccf-158e-46e9-b17e-86dcb35bec80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:12.161565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f93ccf-158e-46e9-b17e-86dcb35bec80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:12.164253 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f93ccf-158e-46e9-b17e-86dcb35bec80 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:12.182450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1149/2313] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:12.186683 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba10d33-d894-4209-8d7f-1ca158c80d45 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:12.197947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba10d33-d894-4209-8d7f-1ca158c80d45 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:12.203890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fb558-1819-4322-92c5-3aa0661a0d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:12.204962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb558-1819-4322-92c5-3aa0661a0d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:12.205238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb558-1819-4322-92c5-3aa0661a0d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:12.205521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb558-1819-4322-92c5-3aa0661a0d40 admin admin] PATH_INFO: `/v3/projects/5db7a5c975224cbeaf0a90166eb43bdd/users/2a1ec81732b541ce84b1fd1f2b827139/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:12.255191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fb558-1819-4322-92c5-3aa0661a0d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db7a5c975224cbeaf0a90166eb43bdd, user_id=2a1ec81732b541ce84b1fd1f2b827139, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:12.261744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fb558-1819-4322-92c5-3aa0661a0d40 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:12.367273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1165/2314] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:42:12 2022] PUT /identity/v3/projects/5db7a5c975224cbeaf0a90166eb43bdd/users/2a1ec81732b541ce84b1fd1f2b827139/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:12.378489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c89b-6736-4ea6-a1ad-676f10e6547b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:12.379371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c89b-6736-4ea6-a1ad-676f10e6547b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:12.379818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c89b-6736-4ea6-a1ad-676f10e6547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:12.415760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0454c89b-6736-4ea6-a1ad-676f10e6547b None None] MFA Rules not processed for user `2a1ec81732b541ce84b1fd1f2b827139`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:12.417429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0454c89b-6736-4ea6-a1ad-676f10e6547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:12.620436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1150/2315] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:12.628317 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fb558-1819-4322-92c5-3aa0661a0d40 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:12.632120 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ff0fb558-1819-4322-92c5-3aa0661a0d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:12.719404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fb558-1819-4322-92c5-3aa0661a0d40 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:12.727161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84122633-3af5-45fc-bd69-4e4f8c6296ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:12.729007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84122633-3af5-45fc-bd69-4e4f8c6296ee service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:12.729641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84122633-3af5-45fc-bd69-4e4f8c6296ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:12.730108 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84122633-3af5-45fc-bd69-4e4f8c6296ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:12.742245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84122633-3af5-45fc-bd69-4e4f8c6296ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:12.744578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84122633-3af5-45fc-bd69-4e4f8c6296ee service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:12.757925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1166/2316] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:14.669330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f656-26ab-4cdd-82ab-2546ae83709a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:14.669955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f656-26ab-4cdd-82ab-2546ae83709a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:14.669955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f656-26ab-4cdd-82ab-2546ae83709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:14.701254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1a14f656-26ab-4cdd-82ab-2546ae83709a None None] MFA Rules not processed for user `4ff783fe5acd4ba485061cfb681db34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:14.702729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1a14f656-26ab-4cdd-82ab-2546ae83709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:14.848905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1151/2317] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:42:14.864622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84122633-3af5-45fc-bd69-4e4f8c6296ee service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:14.867617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-84122633-3af5-45fc-bd69-4e4f8c6296ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:15.025366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:15.036301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84122633-3af5-45fc-bd69-4e4f8c6296ee service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:15.041069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34759e-9fb4-4db4-a1d0-ffa1087ab2b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff915d0b23d4b9ebd70e6b6b885aca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:15.042210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34759e-9fb4-4db4-a1d0-ffa1087ab2b4 service glance] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:15.042737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34759e-9fb4-4db4-a1d0-ffa1087ab2b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:15.043229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34759e-9fb4-4db4-a1d0-ffa1087ab2b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:15.045887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-2c34759e-9fb4-4db4-a1d0-ffa1087ab2b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:15.147808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34759e-9fb4-4db4-a1d0-ffa1087ab2b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:15.149450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34759e-9fb4-4db4-a1d0-ffa1087ab2b4 service glance] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:15.161150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1167/2318] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:15.572369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dacd5c-8466-416f-a1f1-aab90c59f6e2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:15.572904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dacd5c-8466-416f-a1f1-aab90c59f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:15.573631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dacd5c-8466-416f-a1f1-aab90c59f6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:15.615734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-74dacd5c-8466-416f-a1f1-aab90c59f6e2 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:15.620259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-74dacd5c-8466-416f-a1f1-aab90c59f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:15.702209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:15.775130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1152/2319] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:42:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:42:15.799412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34759e-9fb4-4db4-a1d0-ffa1087ab2b4 service glance] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:15.799412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-2c34759e-9fb4-4db4-a1d0-ffa1087ab2b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:15.947211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34759e-9fb4-4db4-a1d0-ffa1087ab2b4 service glance] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:15.962718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516805f7-5f5a-4ea6-aa6f-930e2058d5dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:15.962718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516805f7-5f5a-4ea6-aa6f-930e2058d5dd service swift] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:15.962718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516805f7-5f5a-4ea6-aa6f-930e2058d5dd service swift] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:15.962718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516805f7-5f5a-4ea6-aa6f-930e2058d5dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:15.988818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516805f7-5f5a-4ea6-aa6f-930e2058d5dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:15.990691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516805f7-5f5a-4ea6-aa6f-930e2058d5dd service swift] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:16.016584 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1168/2320] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:42:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:42:26.009942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=61 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:26.051602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=12 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:32.058902 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25221ec-f74d-4885-ae8b-17ac803ff473 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:32.066941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25221ec-f74d-4885-ae8b-17ac803ff473 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:32.066941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25221ec-f74d-4885-ae8b-17ac803ff473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:32.076967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f25221ec-f74d-4885-ae8b-17ac803ff473 None None] MFA Rules not processed for user `b26d3bc7b17b4ec79a6bff51ccdf1bee`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:32.078174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f25221ec-f74d-4885-ae8b-17ac803ff473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:32.086193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1153/2321] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:33.025022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bf083-b8d8-4829-8379-52b1c5b2f1af None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:33.025022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bf083-b8d8-4829-8379-52b1c5b2f1af None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:33.025022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bf083-b8d8-4829-8379-52b1c5b2f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:33.036669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-973bf083-b8d8-4829-8379-52b1c5b2f1af None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:33.039141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-973bf083-b8d8-4829-8379-52b1c5b2f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:33.047090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1169/2322] 10.222.0.77 () {58 vars in 967 bytes} [Thu Jun 16 17:42:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:33.059644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25221ec-f74d-4885-ae8b-17ac803ff473 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:33.071653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25221ec-f74d-4885-ae8b-17ac803ff473 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:33.076653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e3218-5f8e-48b1-bc27-06df3b28cce9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:33.077313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e3218-5f8e-48b1-bc27-06df3b28cce9 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:33.077573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e3218-5f8e-48b1-bc27-06df3b28cce9 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:33.077845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e3218-5f8e-48b1-bc27-06df3b28cce9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:33.086717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e3218-5f8e-48b1-bc27-06df3b28cce9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:33.088306 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e3218-5f8e-48b1-bc27-06df3b28cce9 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:33.096929 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1154/2323] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:42:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:42:33.461684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bf083-b8d8-4829-8379-52b1c5b2f1af None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:33.526439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bf083-b8d8-4829-8379-52b1c5b2f1af None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:33.530928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:33.531805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:33.532111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:33.532397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] PATH_INFO: `/v3/users/2a1ec81732b541ce84b1fd1f2b827139` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:33.533578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1ec81732b541ce84b1fd1f2b827139)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:33.547607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:33.900124 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1ec81732b541ce84b1fd1f2b827139'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:33.913579 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1ec81732b541ce84b1fd1f2b827139'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:34.056859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1ec81732b541ce84b1fd1f2b827139'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:34.057544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1ec81732b541ce84b1fd1f2b827139'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:34.058159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1ec81732b541ce84b1fd1f2b827139'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:34.072670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1170/2324] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:42:33 2022] DELETE /identity/v3/users/2a1ec81732b541ce84b1fd1f2b827139 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:34.077232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6bf5-5120-417f-9c23-8e6b2c26201e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:34.077686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6bf5-5120-417f-9c23-8e6b2c26201e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:34.077779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6bf5-5120-417f-9c23-8e6b2c26201e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:34.099006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f44f6bf5-5120-417f-9c23-8e6b2c26201e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:34.100819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f44f6bf5-5120-417f-9c23-8e6b2c26201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:34.164273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1155/2325] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:42:34.174093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:34.175695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:34.237185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d609c-21aa-4dd0-94ff-527dad56fb67 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:34.241209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90c4e6-f692-4d68-a87e-746e35ffb76d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:34.243045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90c4e6-f692-4d68-a87e-746e35ffb76d service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:34.243045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90c4e6-f692-4d68-a87e-746e35ffb76d service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:34.243045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90c4e6-f692-4d68-a87e-746e35ffb76d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:34.251772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90c4e6-f692-4d68-a87e-746e35ffb76d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:34.253239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90c4e6-f692-4d68-a87e-746e35ffb76d service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:34.263353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1171/2326] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:34.755476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f6bf5-5120-417f-9c23-8e6b2c26201e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:34.757719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f44f6bf5-5120-417f-9c23-8e6b2c26201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:34.771028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f6bf5-5120-417f-9c23-8e6b2c26201e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:34.777995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:34.779041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:34.779278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:34.779558 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] PATH_INFO: `/v3/projects/5db7a5c975224cbeaf0a90166eb43bdd` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:34.780783 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db7a5c975224cbeaf0a90166eb43bdd)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:34.782705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:35.006159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db7a5c975224cbeaf0a90166eb43bdd', 'request_id': 'req-d7b71a19-8385-436e-b9ad-9c5d75c87d08'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:35.012549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db7a5c975224cbeaf0a90166eb43bdd', 'request_id': 'req-d7b71a19-8385-436e-b9ad-9c5d75c87d08'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:35.165082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db7a5c975224cbeaf0a90166eb43bdd', 'request_id': 'req-d7b71a19-8385-436e-b9ad-9c5d75c87d08'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:35.195223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90c4e6-f692-4d68-a87e-746e35ffb76d service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:35.196701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8b90c4e6-f692-4d68-a87e-746e35ffb76d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:35.202026 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] The token cache is being invalidate because project 5db7a5c975224cbeaf0a90166eb43bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:42:35.202388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:35.203170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:35.206453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1156/2327] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:42:34 2022] DELETE /identity/v3/projects/5db7a5c975224cbeaf0a90166eb43bdd => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:35.242190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:35.360413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90c4e6-f692-4d68-a87e-746e35ffb76d service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:35.435673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf04fa-d445-4518-a26c-38bf82362635 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:35.436384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf04fa-d445-4518-a26c-38bf82362635 service placement] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:35.436674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf04fa-d445-4518-a26c-38bf82362635 service placement] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:35.437000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf04fa-d445-4518-a26c-38bf82362635 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:35.438920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3adf04fa-d445-4518-a26c-38bf82362635 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:35.452286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf04fa-d445-4518-a26c-38bf82362635 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:35.453872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf04fa-d445-4518-a26c-38bf82362635 service placement] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:35.465455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1172/2328] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:42:36.899315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:36.901011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:36.987027 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b71a19-8385-436e-b9ad-9c5d75c87d08 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:36.992799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:36.993778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:36.994677 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:36.994964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] PATH_INFO: `/v3/users/2ab213d4944042199ee9405ed9366c6f` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:36.996196 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab213d4944042199ee9405ed9366c6f)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:36.998113 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:37.008272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:37.272280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab213d4944042199ee9405ed9366c6f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:37.295557 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab213d4944042199ee9405ed9366c6f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:37.415869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab213d4944042199ee9405ed9366c6f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:37.416656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab213d4944042199ee9405ed9366c6f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:37.417270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab213d4944042199ee9405ed9366c6f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:37.433091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1157/2329] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:42:36 2022] DELETE /identity/v3/users/2ab213d4944042199ee9405ed9366c6f => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:42:37.455918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77b55a-0957-461e-8962-5d30634eea79 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:37.457803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77b55a-0957-461e-8962-5d30634eea79 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:37.457803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77b55a-0957-461e-8962-5d30634eea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:37.475395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-de77b55a-0957-461e-8962-5d30634eea79 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:37.477178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-de77b55a-0957-461e-8962-5d30634eea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:37.542900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1173/2330] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:42:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:37.557212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:37.558676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:37.646070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec82dc-cdb1-4c31-86da-6e7f36775407 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:37.651846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82b99d-01bf-46ba-aa37-744511b0ad8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:37.652610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b99d-01bf-46ba-aa37-744511b0ad8f service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:37.652968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b99d-01bf-46ba-aa37-744511b0ad8f service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:37.653269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b99d-01bf-46ba-aa37-744511b0ad8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:37.662093 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82b99d-01bf-46ba-aa37-744511b0ad8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:37.665054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82b99d-01bf-46ba-aa37-744511b0ad8f service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:37.673967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1158/2331] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:42:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:42:37.729219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77b55a-0957-461e-8962-5d30634eea79 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:37.729629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-de77b55a-0957-461e-8962-5d30634eea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:37.783422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:37.824021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77b55a-0957-461e-8962-5d30634eea79 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:37.845109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:37.847127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:37.848649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:37.850121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] PATH_INFO: `/v3/projects/3b2352c5c11848a7a2d66817baebe808` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:37.858981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2352c5c11848a7a2d66817baebe808)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:37.872265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:38.107401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2352c5c11848a7a2d66817baebe808', 'request_id': 'req-5261ede4-cf2a-4a2a-a29c-b4470db7827e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:38.115698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2352c5c11848a7a2d66817baebe808', 'request_id': 'req-5261ede4-cf2a-4a2a-a29c-b4470db7827e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:38.124238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2352c5c11848a7a2d66817baebe808', 'request_id': 'req-5261ede4-cf2a-4a2a-a29c-b4470db7827e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:38.313119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] The token cache is being invalidate because project 3b2352c5c11848a7a2d66817baebe808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:42:38.317426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:38.317426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-5261ede4-cf2a-4a2a-a29c-b4470db7827e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:38.317426 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1174/2332] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:42:37 2022] DELETE /identity/v3/projects/3b2352c5c11848a7a2d66817baebe808 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:38.322510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc397c-62e5-41be-b370-57be3d86b96c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:38.323013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc397c-62e5-41be-b370-57be3d86b96c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:38.323167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc397c-62e5-41be-b370-57be3d86b96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:38.353294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-30dc397c-62e5-41be-b370-57be3d86b96c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:38.357336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-30dc397c-62e5-41be-b370-57be3d86b96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:38.518602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1159/2333] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:38.525855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e67d3-1320-4143-bd6a-946ff1c8fc45 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:38.526784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e67d3-1320-4143-bd6a-946ff1c8fc45 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:38.527213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e67d3-1320-4143-bd6a-946ff1c8fc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:38.567073 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-cf7e67d3-1320-4143-bd6a-946ff1c8fc45 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:38.569243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cf7e67d3-1320-4143-bd6a-946ff1c8fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:38.591196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1175/2334] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:38.595524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc397c-62e5-41be-b370-57be3d86b96c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:38.610473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc397c-62e5-41be-b370-57be3d86b96c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:38.620358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f5d8-73af-448a-93d0-573eec42a353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:38.621037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f5d8-73af-448a-93d0-573eec42a353 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:38.621322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f5d8-73af-448a-93d0-573eec42a353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:38.621594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f5d8-73af-448a-93d0-573eec42a353 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:38.622327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7f5d8-73af-448a-93d0-573eec42a353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:42:38.622642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7f5d8-73af-448a-93d0-573eec42a353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:38.624598 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7f5d8-73af-448a-93d0-573eec42a353 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:38.635432 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:38.642812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1160/2335] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:42:38.644055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e67d3-1320-4143-bd6a-946ff1c8fc45 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:38.658200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e67d3-1320-4143-bd6a-946ff1c8fc45 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:38.677913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d3ff5-6af4-4174-bace-4e0dab275564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:38.682836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d3ff5-6af4-4174-bace-4e0dab275564 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:38.682836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d3ff5-6af4-4174-bace-4e0dab275564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:38.683136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d3ff5-6af4-4174-bace-4e0dab275564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:38.683891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d3ff5-6af4-4174-bace-4e0dab275564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:38.689821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d3ff5-6af4-4174-bace-4e0dab275564 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:38.798214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f5d8-73af-448a-93d0-573eec42a353 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:38.809315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1176/2336] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:42:38 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:42:38.815646 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f5d8-73af-448a-93d0-573eec42a353 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:38.936479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca39822-aa7b-4ebc-be1f-e1a9daa1da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:38.937155 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca39822-aa7b-4ebc-be1f-e1a9daa1da88 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:38.937748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca39822-aa7b-4ebc-be1f-e1a9daa1da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:38.938042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca39822-aa7b-4ebc-be1f-e1a9daa1da88 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:38.939147 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca39822-aa7b-4ebc-be1f-e1a9daa1da88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:38.941465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca39822-aa7b-4ebc-be1f-e1a9daa1da88 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:39.130288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d3ff5-6af4-4174-bace-4e0dab275564 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:39.136738 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1161/2337] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:42:38 2022] POST /identity/v3/users => generated 286 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:42:39.142170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d3ff5-6af4-4174-bace-4e0dab275564 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:39.150369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51714b-31f6-4f49-bce3-54d4cb76e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:39.151323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51714b-31f6-4f49-bce3-54d4cb76e43c admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:39.151838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51714b-31f6-4f49-bce3-54d4cb76e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:39.152306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51714b-31f6-4f49-bce3-54d4cb76e43c admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:39.153191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51714b-31f6-4f49-bce3-54d4cb76e43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:39.154960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51714b-31f6-4f49-bce3-54d4cb76e43c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:39.168140 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1177/2338] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:39.171983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca39822-aa7b-4ebc-be1f-e1a9daa1da88 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:39.185589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca39822-aa7b-4ebc-be1f-e1a9daa1da88 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:39.190969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898061c-f55f-4dc7-97d1-72b5e05c8155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:39.191810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898061c-f55f-4dc7-97d1-72b5e05c8155 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:39.192190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898061c-f55f-4dc7-97d1-72b5e05c8155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:39.192651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898061c-f55f-4dc7-97d1-72b5e05c8155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:39.193475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898061c-f55f-4dc7-97d1-72b5e05c8155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:39.196299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898061c-f55f-4dc7-97d1-72b5e05c8155 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:39.207984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1162/2339] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:39.213532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51714b-31f6-4f49-bce3-54d4cb76e43c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:39.223747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51714b-31f6-4f49-bce3-54d4cb76e43c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:39.228795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ba3d7-e676-4295-a376-21a78b35a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:39.229752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ba3d7-e676-4295-a376-21a78b35a9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:39.230024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ba3d7-e676-4295-a376-21a78b35a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:39.230305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ba3d7-e676-4295-a376-21a78b35a9e1 admin admin] PATH_INFO: `/v3/projects/b1cf3ca54d184e0686043ce0a6246ce0/users/9227fd959e544b00b5276277b80d29c3/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:39.245602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ba3d7-e676-4295-a376-21a78b35a9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1cf3ca54d184e0686043ce0a6246ce0, user_id=9227fd959e544b00b5276277b80d29c3, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:39.248322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ba3d7-e676-4295-a376-21a78b35a9e1 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:39.353916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1178/2340] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:42:39 2022] PUT /identity/v3/projects/b1cf3ca54d184e0686043ce0a6246ce0/users/9227fd959e544b00b5276277b80d29c3/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:42:39.364686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a9a0-aab6-46e2-bf13-4151175587ec None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:39.365247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a9a0-aab6-46e2-bf13-4151175587ec None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:39.365247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a9a0-aab6-46e2-bf13-4151175587ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:39.404262 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ed54a9a0-aab6-46e2-bf13-4151175587ec None None] MFA Rules not processed for user `9227fd959e544b00b5276277b80d29c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:39.405456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ed54a9a0-aab6-46e2-bf13-4151175587ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:39.478082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1163/2341] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:39.490145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ba3d7-e676-4295-a376-21a78b35a9e1 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:39.492139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4a0ba3d7-e676-4295-a376-21a78b35a9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:39.574807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ba3d7-e676-4295-a376-21a78b35a9e1 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:39.581059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853abf55-e02c-4e7e-90f1-db335da18b8b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff915d0b23d4b9ebd70e6b6b885aca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:39.581825 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853abf55-e02c-4e7e-90f1-db335da18b8b service glance] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:39.582240 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853abf55-e02c-4e7e-90f1-db335da18b8b service glance] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:39.582637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853abf55-e02c-4e7e-90f1-db335da18b8b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:39.593637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853abf55-e02c-4e7e-90f1-db335da18b8b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:39.595170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853abf55-e02c-4e7e-90f1-db335da18b8b service glance] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:39.608649 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a9a0-aab6-46e2-bf13-4151175587ec None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:39.610935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ed54a9a0-aab6-46e2-bf13-4151175587ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:39.616902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1179/2342] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:39.724425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a9a0-aab6-46e2-bf13-4151175587ec None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:39.732723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:39.733627 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:39.733909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:39.734184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] PATH_INFO: `/v3/users/ddf42a1eb96545918038781cebda23ca` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:39.735435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf42a1eb96545918038781cebda23ca)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:39.737634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:39.756452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:39.977354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf42a1eb96545918038781cebda23ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:39.993520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf42a1eb96545918038781cebda23ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:40.079374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf42a1eb96545918038781cebda23ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:40.080130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf42a1eb96545918038781cebda23ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:40.080987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf42a1eb96545918038781cebda23ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:40.097026 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1164/2343] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:42:39 2022] DELETE /identity/v3/users/ddf42a1eb96545918038781cebda23ca => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:40.104168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb707-57ab-42b5-a38c-3cb631bbbe73 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:40.104538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb707-57ab-42b5-a38c-3cb631bbbe73 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:40.104755 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb707-57ab-42b5-a38c-3cb631bbbe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:40.110708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:40.123082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4c2eb707-57ab-42b5-a38c-3cb631bbbe73 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:40.127208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4c2eb707-57ab-42b5-a38c-3cb631bbbe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:40.183716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1180/2344] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:40.193542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:40.195749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:40.259688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845467d4-364f-4ed6-9f25-139d6927ee3f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:40.263705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6f5e3-4d82-4cc4-aca0-7830d323c489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:40.264918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6f5e3-4d82-4cc4-aca0-7830d323c489 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:40.264918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6f5e3-4d82-4cc4-aca0-7830d323c489 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:40.265225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6f5e3-4d82-4cc4-aca0-7830d323c489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:40.278531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6f5e3-4d82-4cc4-aca0-7830d323c489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:40.280191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6f5e3-4d82-4cc4-aca0-7830d323c489 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:40.292923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1165/2345] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:40.793867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb707-57ab-42b5-a38c-3cb631bbbe73 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:40.795514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4c2eb707-57ab-42b5-a38c-3cb631bbbe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:40.818743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb707-57ab-42b5-a38c-3cb631bbbe73 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:40.825828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:40.827347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:40.827623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:40.827956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] PATH_INFO: `/v3/projects/9542aa9a0bc24753847a92923c4fbe08` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:40.829394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9542aa9a0bc24753847a92923c4fbe08)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:40.831992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:41.010412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9542aa9a0bc24753847a92923c4fbe08', 'request_id': 'req-36bfe3d8-6288-4ad2-8821-1f3672f495a7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:41.016432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9542aa9a0bc24753847a92923c4fbe08', 'request_id': 'req-36bfe3d8-6288-4ad2-8821-1f3672f495a7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:41.023520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9542aa9a0bc24753847a92923c4fbe08', 'request_id': 'req-36bfe3d8-6288-4ad2-8821-1f3672f495a7'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:41.130912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] The token cache is being invalidate because project 9542aa9a0bc24753847a92923c4fbe08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:42:41.130912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:41.130912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-36bfe3d8-6288-4ad2-8821-1f3672f495a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:42:41.130912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1181/2346] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:42:40 2022] DELETE /identity/v3/projects/9542aa9a0bc24753847a92923c4fbe08 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:42:41.131395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0f603-190a-4610-abd4-02b07753b522 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:41.131395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0f603-190a-4610-abd4-02b07753b522 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:41.131395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0f603-190a-4610-abd4-02b07753b522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:41.169390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bdb0f603-190a-4610-abd4-02b07753b522 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:41.170722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bdb0f603-190a-4610-abd4-02b07753b522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:41.253194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1166/2347] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:41.261908 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c052d-a297-4a9b-b1a0-a3a4c500f05a None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:41.262206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c052d-a297-4a9b-b1a0-a3a4c500f05a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:41.262487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c052d-a297-4a9b-b1a0-a3a4c500f05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:41.286219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ba3c052d-a297-4a9b-b1a0-a3a4c500f05a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:41.286219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ba3c052d-a297-4a9b-b1a0-a3a4c500f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:41.293765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1182/2348] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:41.300217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0f603-190a-4610-abd4-02b07753b522 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:41.312292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0f603-190a-4610-abd4-02b07753b522 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:41.317484 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b050c-9218-4895-849e-05909dfc7677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:41.323358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b050c-9218-4895-849e-05909dfc7677 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:41.323358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b050c-9218-4895-849e-05909dfc7677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:41.323358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b050c-9218-4895-849e-05909dfc7677 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:41.323358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b050c-9218-4895-849e-05909dfc7677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:42:41.323358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b050c-9218-4895-849e-05909dfc7677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:41.323358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b050c-9218-4895-849e-05909dfc7677 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:41.335227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1167/2349] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:42:41.339806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c052d-a297-4a9b-b1a0-a3a4c500f05a None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:41.349986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c052d-a297-4a9b-b1a0-a3a4c500f05a None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:41.354635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e8062-f3ca-4f73-a7f4-979aa9c43c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:41.355316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e8062-f3ca-4f73-a7f4-979aa9c43c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:41.355607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e8062-f3ca-4f73-a7f4-979aa9c43c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:41.355881 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e8062-f3ca-4f73-a7f4-979aa9c43c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:41.356602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e8062-f3ca-4f73-a7f4-979aa9c43c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:41.358740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e8062-f3ca-4f73-a7f4-979aa9c43c2c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:41.452020 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1183/2350] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:42:41 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:42:41.456948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b050c-9218-4895-849e-05909dfc7677 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:41.468371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b050c-9218-4895-849e-05909dfc7677 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:41.483230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:41.536528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58875271-f6a0-4446-98f4-5b4ec062fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:41.537220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58875271-f6a0-4446-98f4-5b4ec062fc38 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:41.537505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58875271-f6a0-4446-98f4-5b4ec062fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:41.537781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58875271-f6a0-4446-98f4-5b4ec062fc38 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:41.539163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58875271-f6a0-4446-98f4-5b4ec062fc38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:41.541127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58875271-f6a0-4446-98f4-5b4ec062fc38 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:41.617751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1168/2351] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:42:41 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:42:41.622364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e8062-f3ca-4f73-a7f4-979aa9c43c2c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:41.633967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e8062-f3ca-4f73-a7f4-979aa9c43c2c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:41.638704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718aa1a-6d7f-4c5a-9a3e-0176fac532da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:41.639383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718aa1a-6d7f-4c5a-9a3e-0176fac532da admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:41.639666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718aa1a-6d7f-4c5a-9a3e-0176fac532da admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:41.639939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718aa1a-6d7f-4c5a-9a3e-0176fac532da admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:41.640702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718aa1a-6d7f-4c5a-9a3e-0176fac532da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:41.642286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718aa1a-6d7f-4c5a-9a3e-0176fac532da admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:41.654251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1184/2352] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:41.658982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58875271-f6a0-4446-98f4-5b4ec062fc38 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:41.691610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58875271-f6a0-4446-98f4-5b4ec062fc38 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:41.721546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ca3e-d770-4413-864c-6a971e7ca108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:41.722635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ca3e-d770-4413-864c-6a971e7ca108 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:41.723045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ca3e-d770-4413-864c-6a971e7ca108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:41.723477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ca3e-d770-4413-864c-6a971e7ca108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:41.724443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397ca3e-d770-4413-864c-6a971e7ca108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:41.726961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397ca3e-d770-4413-864c-6a971e7ca108 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:41.745937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1169/2353] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:42:41.750032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718aa1a-6d7f-4c5a-9a3e-0176fac532da admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:41.761950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718aa1a-6d7f-4c5a-9a3e-0176fac532da admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:41.766984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75442cbe-f0ba-456b-b7ad-d14bf437dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:41.768115 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442cbe-f0ba-456b-b7ad-d14bf437dd1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:41.768619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442cbe-f0ba-456b-b7ad-d14bf437dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:41.768854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442cbe-f0ba-456b-b7ad-d14bf437dd1b admin admin] PATH_INFO: `/v3/projects/1cf90de21f274543a4e8d59127cf3723/users/7cdb30904dd14935ba8cd96a1136ccbf/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:41.786262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75442cbe-f0ba-456b-b7ad-d14bf437dd1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf90de21f274543a4e8d59127cf3723, user_id=7cdb30904dd14935ba8cd96a1136ccbf, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:41.789638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75442cbe-f0ba-456b-b7ad-d14bf437dd1b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:41.907947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1185/2354] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:42:41 2022] PUT /identity/v3/projects/1cf90de21f274543a4e8d59127cf3723/users/7cdb30904dd14935ba8cd96a1136ccbf/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:42:41.919556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984064af-67f0-4ad0-8087-c87f828dff1d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:41.919855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984064af-67f0-4ad0-8087-c87f828dff1d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:41.920183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984064af-67f0-4ad0-8087-c87f828dff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:41.949404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-984064af-67f0-4ad0-8087-c87f828dff1d None None] MFA Rules not processed for user `7cdb30904dd14935ba8cd96a1136ccbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:42:41.951297 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-984064af-67f0-4ad0-8087-c87f828dff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:42.020513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1170/2355] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:42:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:42:42.034570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75442cbe-f0ba-456b-b7ad-d14bf437dd1b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:42:42.036375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-75442cbe-f0ba-456b-b7ad-d14bf437dd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:42:42.065138 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:42.121726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75442cbe-f0ba-456b-b7ad-d14bf437dd1b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:42:42.126263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd0549-835b-4ae3-aa1c-ca5a37f2c589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:42:42.127234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0549-835b-4ae3-aa1c-ca5a37f2c589 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:42:42.127709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0549-835b-4ae3-aa1c-ca5a37f2c589 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:42:42.128205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0549-835b-4ae3-aa1c-ca5a37f2c589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:42:42.138950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd0549-835b-4ae3-aa1c-ca5a37f2c589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:42:42.141281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd0549-835b-4ae3-aa1c-ca5a37f2c589 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:42:42.153095 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1186/2356] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:42:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:42:52.016717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:52.277402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=16 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:04.364480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141be1d-99c3-4179-bb65-8b21ce15750a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:04.364996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141be1d-99c3-4179-bb65-8b21ce15750a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:04.365094 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141be1d-99c3-4179-bb65-8b21ce15750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:04.383475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e141be1d-99c3-4179-bb65-8b21ce15750a None None] MFA Rules not processed for user `97e53b295eb24d558023b8a120dad771`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:04.385257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e141be1d-99c3-4179-bb65-8b21ce15750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:04.443031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1171/2357] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:43:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:43:07.774255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348435d-08f5-46ee-8655-9bb08bf37629 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:07.776532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348435d-08f5-46ee-8655-9bb08bf37629 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:07.776927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348435d-08f5-46ee-8655-9bb08bf37629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:07.797064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-b348435d-08f5-46ee-8655-9bb08bf37629 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:07.798662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b348435d-08f5-46ee-8655-9bb08bf37629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:07.870685 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1187/2358] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:43:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:43:07.893436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141be1d-99c3-4179-bb65-8b21ce15750a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:07.894884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e141be1d-99c3-4179-bb65-8b21ce15750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:07.987328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141be1d-99c3-4179-bb65-8b21ce15750a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:07.993291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11e0f-af47-410f-91e8-b8522c3f30f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:07.994135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11e0f-af47-410f-91e8-b8522c3f30f5 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:07.994425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11e0f-af47-410f-91e8-b8522c3f30f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:07.994723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11e0f-af47-410f-91e8-b8522c3f30f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:08.003643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11e0f-af47-410f-91e8-b8522c3f30f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:08.005251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11e0f-af47-410f-91e8-b8522c3f30f5 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:08.014313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1172/2359] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:43:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:43:17.863408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=25 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:18.010884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=57 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:18.281619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348435d-08f5-46ee-8655-9bb08bf37629 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:18.283276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b348435d-08f5-46ee-8655-9bb08bf37629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:18.354022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348435d-08f5-46ee-8655-9bb08bf37629 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:18.357693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecffa72-203e-4941-a3c9-c1b41409997a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:18.358347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecffa72-203e-4941-a3c9-c1b41409997a service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:18.358633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecffa72-203e-4941-a3c9-c1b41409997a service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:18.358912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecffa72-203e-4941-a3c9-c1b41409997a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:18.360799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5ecffa72-203e-4941-a3c9-c1b41409997a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:18.504814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecffa72-203e-4941-a3c9-c1b41409997a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:18.506359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecffa72-203e-4941-a3c9-c1b41409997a service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:18.520987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1188/2360] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:43:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:43:24.803894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11e0f-af47-410f-91e8-b8522c3f30f5 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:24.806324 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-57b11e0f-af47-410f-91e8-b8522c3f30f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:24.884559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11e0f-af47-410f-91e8-b8522c3f30f5 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:24.889092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:24.889968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:24.890247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:24.890520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] PATH_INFO: `/v3/users/9227fd959e544b00b5276277b80d29c3` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:24.891711 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9227fd959e544b00b5276277b80d29c3)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:24.893729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:25.157618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9227fd959e544b00b5276277b80d29c3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:25.174303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9227fd959e544b00b5276277b80d29c3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:25.265527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9227fd959e544b00b5276277b80d29c3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:25.265888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9227fd959e544b00b5276277b80d29c3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:25.266597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9227fd959e544b00b5276277b80d29c3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:25.280760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1173/2361] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:43:24 2022] DELETE /identity/v3/users/9227fd959e544b00b5276277b80d29c3 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:43:25.286490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f8260-7873-42ea-bc3b-3def6d2e3f57 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:25.287054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f8260-7873-42ea-bc3b-3def6d2e3f57 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:25.287054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f8260-7873-42ea-bc3b-3def6d2e3f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:25.306506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-b96f8260-7873-42ea-bc3b-3def6d2e3f57 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:25.307791 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b96f8260-7873-42ea-bc3b-3def6d2e3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:25.376239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1189/2362] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:43:25.386125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:25.387550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:25.466672 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebc0d7-127e-44ca-bf14-6ff590a47a66 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:25.471276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce48c6f-9c7f-4feb-a7a9-b623b521764a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:25.472055 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce48c6f-9c7f-4feb-a7a9-b623b521764a service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:25.472338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce48c6f-9c7f-4feb-a7a9-b623b521764a service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:25.472620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce48c6f-9c7f-4feb-a7a9-b623b521764a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:25.483384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce48c6f-9c7f-4feb-a7a9-b623b521764a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:25.484906 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce48c6f-9c7f-4feb-a7a9-b623b521764a service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:25.496651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1174/2363] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:43:26.191924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f8260-7873-42ea-bc3b-3def6d2e3f57 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:26.193263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b96f8260-7873-42ea-bc3b-3def6d2e3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:26.216721 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f8260-7873-42ea-bc3b-3def6d2e3f57 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:26.222439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:26.223365 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:26.223751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:26.224348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] PATH_INFO: `/v3/projects/b1cf3ca54d184e0686043ce0a6246ce0` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:26.225843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1cf3ca54d184e0686043ce0a6246ce0)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:26.228285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:26.355845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:26.368968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1cf3ca54d184e0686043ce0a6246ce0', 'request_id': 'req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:26.377868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1cf3ca54d184e0686043ce0a6246ce0', 'request_id': 'req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:26.391171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1cf3ca54d184e0686043ce0a6246ce0', 'request_id': 'req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:26.460283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] The token cache is being invalidate because project b1cf3ca54d184e0686043ce0a6246ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:43:26.460851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:26.462168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-12ebb5b7-ac31-47b5-b725-b6c8be6c015c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:26.464148 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1190/2364] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:43:26 2022] DELETE /identity/v3/projects/b1cf3ca54d184e0686043ce0a6246ce0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:43:26.469748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13bdf6-5307-4d2c-9ca7-122c2c9d5ab1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:26.470282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13bdf6-5307-4d2c-9ca7-122c2c9d5ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:26.470554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13bdf6-5307-4d2c-9ca7-122c2c9d5ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:26.490183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6b13bdf6-5307-4d2c-9ca7-122c2c9d5ab1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:26.491627 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6b13bdf6-5307-4d2c-9ca7-122c2c9d5ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:26.515382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:26.563940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1175/2365] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:43:26.572410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51bbf2-178f-4886-85a2-5783d013a27f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:26.572863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51bbf2-178f-4886-85a2-5783d013a27f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:26.573248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51bbf2-178f-4886-85a2-5783d013a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:26.598844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ab51bbf2-178f-4886-85a2-5783d013a27f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:26.600449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ab51bbf2-178f-4886-85a2-5783d013a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:26.610827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1191/2366] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:43:26.615577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13bdf6-5307-4d2c-9ca7-122c2c9d5ab1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:26.627748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13bdf6-5307-4d2c-9ca7-122c2c9d5ab1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:26.640259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79ec8-c104-410d-a898-8d52413634bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:26.641021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79ec8-c104-410d-a898-8d52413634bc admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:26.641513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79ec8-c104-410d-a898-8d52413634bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:26.641854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79ec8-c104-410d-a898-8d52413634bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:26.642736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f79ec8-c104-410d-a898-8d52413634bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:43:26.643176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f79ec8-c104-410d-a898-8d52413634bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:26.645224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f79ec8-c104-410d-a898-8d52413634bc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:26.662360 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1176/2367] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:43:26.667017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51bbf2-178f-4886-85a2-5783d013a27f None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:26.676963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51bbf2-178f-4886-85a2-5783d013a27f None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:26.683556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0a81a-8a13-4563-8957-2fdf57da6e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:26.684485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a81a-8a13-4563-8957-2fdf57da6e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:26.684858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a81a-8a13-4563-8957-2fdf57da6e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:26.685210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a81a-8a13-4563-8957-2fdf57da6e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:26.686119 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0a81a-8a13-4563-8957-2fdf57da6e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:26.693006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0a81a-8a13-4563-8957-2fdf57da6e90 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:26.781611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1192/2368] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:43:26 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:43:26.782841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79ec8-c104-410d-a898-8d52413634bc admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:26.794628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79ec8-c104-410d-a898-8d52413634bc admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:26.921437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c99b4-fb67-402d-918c-ff853a647665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:26.922230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c99b4-fb67-402d-918c-ff853a647665 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:26.922645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c99b4-fb67-402d-918c-ff853a647665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:26.923019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c99b4-fb67-402d-918c-ff853a647665 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:26.923885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c99b4-fb67-402d-918c-ff853a647665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:26.928669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c99b4-fb67-402d-918c-ff853a647665 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:27.041438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1177/2369] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:43:26 2022] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:43:27.044249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0a81a-8a13-4563-8957-2fdf57da6e90 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:27.057578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0a81a-8a13-4563-8957-2fdf57da6e90 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:27.064624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5e02d-9ca6-4b53-80b8-0cd651123ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:27.065708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5e02d-9ca6-4b53-80b8-0cd651123ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:27.065993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5e02d-9ca6-4b53-80b8-0cd651123ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:27.066267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5e02d-9ca6-4b53-80b8-0cd651123ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:27.067025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5e02d-9ca6-4b53-80b8-0cd651123ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:27.068686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5e02d-9ca6-4b53-80b8-0cd651123ebd admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:27.080911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1193/2370] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:43:27.085056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c99b4-fb67-402d-918c-ff853a647665 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:27.095776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c99b4-fb67-402d-918c-ff853a647665 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:27.100419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe0c13-5c5b-4ca5-8153-608c2fb270f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:27.101733 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0c13-5c5b-4ca5-8153-608c2fb270f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:27.102051 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0c13-5c5b-4ca5-8153-608c2fb270f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:27.102330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0c13-5c5b-4ca5-8153-608c2fb270f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:27.103057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe0c13-5c5b-4ca5-8153-608c2fb270f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:27.104667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe0c13-5c5b-4ca5-8153-608c2fb270f9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:27.114963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1178/2371] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:43:27.120094 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5e02d-9ca6-4b53-80b8-0cd651123ebd admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:27.130663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5e02d-9ca6-4b53-80b8-0cd651123ebd admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:27.139753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3742-494f-4d1b-8616-b64b63d7ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:27.140697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3742-494f-4d1b-8616-b64b63d7ec02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:27.140982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3742-494f-4d1b-8616-b64b63d7ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:27.141259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3742-494f-4d1b-8616-b64b63d7ec02 admin admin] PATH_INFO: `/v3/projects/c00cc77a932b4d9989e4bac901464357/users/9b429ed0359f4bbf9aaca121d996a8e0/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:27.164591 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d3742-494f-4d1b-8616-b64b63d7ec02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00cc77a932b4d9989e4bac901464357, user_id=9b429ed0359f4bbf9aaca121d996a8e0, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:27.167552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d3742-494f-4d1b-8616-b64b63d7ec02 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:27.279354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1194/2372] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:43:27 2022] PUT /identity/v3/projects/c00cc77a932b4d9989e4bac901464357/users/9b429ed0359f4bbf9aaca121d996a8e0/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:43:27.290675 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e78ae2-0fb9-4b5b-93b1-226bc1a085ed None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:27.290965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e78ae2-0fb9-4b5b-93b1-226bc1a085ed None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:27.291423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e78ae2-0fb9-4b5b-93b1-226bc1a085ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:27.326568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-67e78ae2-0fb9-4b5b-93b1-226bc1a085ed None None] MFA Rules not processed for user `9b429ed0359f4bbf9aaca121d996a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:27.327819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-67e78ae2-0fb9-4b5b-93b1-226bc1a085ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:27.398656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1179/2373] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:43:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:43:27.410817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3742-494f-4d1b-8616-b64b63d7ec02 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:27.412799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5d4d3742-494f-4d1b-8616-b64b63d7ec02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:27.475507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3742-494f-4d1b-8616-b64b63d7ec02 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:27.480470 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0cf20-cd77-4668-86cd-fb6159b79a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:27.481122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0cf20-cd77-4668-86cd-fb6159b79a7c service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:27.481408 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0cf20-cd77-4668-86cd-fb6159b79a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:27.481687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0cf20-cd77-4668-86cd-fb6159b79a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:27.490282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0cf20-cd77-4668-86cd-fb6159b79a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:27.492508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0cf20-cd77-4668-86cd-fb6159b79a7c service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:27.505483 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1195/2374] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:43:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:43:27.527624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e78ae2-0fb9-4b5b-93b1-226bc1a085ed None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:27.548041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:27.608860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e78ae2-0fb9-4b5b-93b1-226bc1a085ed None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:27.614842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:27.615811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:27.616213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:27.617020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] PATH_INFO: `/v3/users/9b429ed0359f4bbf9aaca121d996a8e0` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:27.618298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b429ed0359f4bbf9aaca121d996a8e0)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:27.620332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:27.944318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b429ed0359f4bbf9aaca121d996a8e0'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:27.958180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b429ed0359f4bbf9aaca121d996a8e0'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:28.089647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b429ed0359f4bbf9aaca121d996a8e0'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:28.090233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b429ed0359f4bbf9aaca121d996a8e0'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:28.090981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b429ed0359f4bbf9aaca121d996a8e0'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:28.105135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1180/2375] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:43:27 2022] DELETE /identity/v3/users/9b429ed0359f4bbf9aaca121d996a8e0 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:43:28.109783 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896ac3-d606-46cc-a444-f98e887a1445 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:28.110073 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896ac3-d606-46cc-a444-f98e887a1445 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:28.110405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896ac3-d606-46cc-a444-f98e887a1445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:28.127223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6a896ac3-d606-46cc-a444-f98e887a1445 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:28.128449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6a896ac3-d606-46cc-a444-f98e887a1445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:28.188013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1196/2376] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:43:28.198189 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:28.199607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:28.259818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6c9ac-9b76-4fa3-b736-f29a76ec74a3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:28.263473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008dcfe-212f-4e41-bb7e-05956a1008e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:28.264151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008dcfe-212f-4e41-bb7e-05956a1008e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:28.264443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008dcfe-212f-4e41-bb7e-05956a1008e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:28.264721 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008dcfe-212f-4e41-bb7e-05956a1008e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:28.274799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008dcfe-212f-4e41-bb7e-05956a1008e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:28.276273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008dcfe-212f-4e41-bb7e-05956a1008e9 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:28.285815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1181/2377] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:43:28.742811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a896ac3-d606-46cc-a444-f98e887a1445 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:28.744337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6a896ac3-d606-46cc-a444-f98e887a1445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:28.759325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a896ac3-d606-46cc-a444-f98e887a1445 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:28.764611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:28.765566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:28.765965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:28.766326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] PATH_INFO: `/v3/projects/c00cc77a932b4d9989e4bac901464357` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:28.767636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00cc77a932b4d9989e4bac901464357)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:28.769658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:28.780973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:28.947675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00cc77a932b4d9989e4bac901464357', 'request_id': 'req-d0531286-66dd-450e-85fd-b7346a8e1185'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:28.953139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00cc77a932b4d9989e4bac901464357', 'request_id': 'req-d0531286-66dd-450e-85fd-b7346a8e1185'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:28.962561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00cc77a932b4d9989e4bac901464357', 'request_id': 'req-d0531286-66dd-450e-85fd-b7346a8e1185'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:29.136333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] The token cache is being invalidate because project c00cc77a932b4d9989e4bac901464357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:43:29.136626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:29.137272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d0531286-66dd-450e-85fd-b7346a8e1185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:29.138918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1197/2378] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:43:28 2022] DELETE /identity/v3/projects/c00cc77a932b4d9989e4bac901464357 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:43:30.958725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048b33-92ae-4455-9dc7-920d5e43f120 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:30.959329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048b33-92ae-4455-9dc7-920d5e43f120 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:30.959329 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048b33-92ae-4455-9dc7-920d5e43f120 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:30.964131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1182/2379] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:43:30.966370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dad23-6a48-4236-82a8-35b2a6cc4b46 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:30.966803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dad23-6a48-4236-82a8-35b2a6cc4b46 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:30.966927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dad23-6a48-4236-82a8-35b2a6cc4b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:31.020227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-de1dad23-6a48-4236-82a8-35b2a6cc4b46 None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:31.025465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-de1dad23-6a48-4236-82a8-35b2a6cc4b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:31.100289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1198/2380] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:43:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:43:31.111796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43048b33-92ae-4455-9dc7-920d5e43f120 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:31.113722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-43048b33-92ae-4455-9dc7-920d5e43f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:31.169764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:31.187273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43048b33-92ae-4455-9dc7-920d5e43f120 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:31.191396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b13e8-a58c-4adb-8506-481e6a917dc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff915d0b23d4b9ebd70e6b6b885aca9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:31.192057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b13e8-a58c-4adb-8506-481e6a917dc7 service glance] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:31.192366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b13e8-a58c-4adb-8506-481e6a917dc7 service glance] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:31.192642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b13e8-a58c-4adb-8506-481e6a917dc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:31.205926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b13e8-a58c-4adb-8506-481e6a917dc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:31.207391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b13e8-a58c-4adb-8506-481e6a917dc7 service glance] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:31.223256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1183/2381] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:43:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:43:31.457572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd71a-9dad-4701-9420-796283c9ae23 None None] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:31.457869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd71a-9dad-4701-9420-796283c9ae23 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:31.458148 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd71a-9dad-4701-9420-796283c9ae23 None None] PATH_INFO: `/` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:31.459675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1199/2382] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:43:31.465507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e911481-b70e-4d0f-a206-e86256fb970a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:31.465883 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e911481-b70e-4d0f-a206-e86256fb970a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:31.466216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e911481-b70e-4d0f-a206-e86256fb970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:31.487134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2e911481-b70e-4d0f-a206-e86256fb970a None None] MFA Rules not processed for user `19ce01cdbd8d4ac9bb126a6814f2d13b`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:31.488294 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2e911481-b70e-4d0f-a206-e86256fb970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:31.556730 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1184/2383] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:43:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:43:31.572687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfd71a-9dad-4701-9420-796283c9ae23 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:31.580826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f5cfd71a-9dad-4701-9420-796283c9ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:31.595353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfd71a-9dad-4701-9420-796283c9ae23 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:31.599261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43352f2-3dac-4d3f-a570-971a70ee7c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:31.599912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43352f2-3dac-4d3f-a570-971a70ee7c20 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:31.600238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43352f2-3dac-4d3f-a570-971a70ee7c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:31.600677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43352f2-3dac-4d3f-a570-971a70ee7c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:31.615118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43352f2-3dac-4d3f-a570-971a70ee7c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:31.619097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43352f2-3dac-4d3f-a570-971a70ee7c20 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:31.627754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1200/2384] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:43:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:43:31.751771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c72a-ac07-4364-a499-db5f5feb7149 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:31.752106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c72a-ac07-4364-a499-db5f5feb7149 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:31.752377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c72a-ac07-4364-a499-db5f5feb7149 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:31.753938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1185/2385] 10.222.0.77 () {54 vars in 921 bytes} [Thu Jun 16 17:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 17:43:31.759993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda525c-fd8e-4fb0-a879-4daebd9dcc79 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:31.760312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda525c-fd8e-4fb0-a879-4daebd9dcc79 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:31.760843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda525c-fd8e-4fb0-a879-4daebd9dcc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:31.782765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6bda525c-fd8e-4fb0-a879-4daebd9dcc79 None None] MFA Rules not processed for user `ba0bb071b7c04e1da55259f079a9c805`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:31.784114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6bda525c-fd8e-4fb0-a879-4daebd9dcc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:31.798211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1201/2386] 10.222.0.77 () {58 vars in 1018 bytes} [Thu Jun 16 17:43:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:43:31.810246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c72a-ac07-4364-a499-db5f5feb7149 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:31.812375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5829c72a-ac07-4364-a499-db5f5feb7149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:31.830258 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c72a-ac07-4364-a499-db5f5feb7149 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:31.834331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487cb10-f187-4ff4-93de-55105fce23ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:31.834997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487cb10-f187-4ff4-93de-55105fce23ad service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:31.839328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487cb10-f187-4ff4-93de-55105fce23ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:31.839328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487cb10-f187-4ff4-93de-55105fce23ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:31.849507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487cb10-f187-4ff4-93de-55105fce23ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:31.851484 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487cb10-f187-4ff4-93de-55105fce23ad service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:31.863719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1186/2387] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:43:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:43:33.806823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda525c-fd8e-4fb0-a879-4daebd9dcc79 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:33.808321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6bda525c-fd8e-4fb0-a879-4daebd9dcc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:33.849870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:33.875698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda525c-fd8e-4fb0-a879-4daebd9dcc79 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:33.880434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:33.881315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:33.881608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:33.881880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] PATH_INFO: `/v3/users/7cdb30904dd14935ba8cd96a1136ccbf` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:33.883272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdb30904dd14935ba8cd96a1136ccbf)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:33.885229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:34.115118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdb30904dd14935ba8cd96a1136ccbf'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:34.128494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdb30904dd14935ba8cd96a1136ccbf'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:34.243758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdb30904dd14935ba8cd96a1136ccbf'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:34.244496 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdb30904dd14935ba8cd96a1136ccbf'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:34.245111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdb30904dd14935ba8cd96a1136ccbf'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:34.258618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1202/2388] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:43:33 2022] DELETE /identity/v3/users/7cdb30904dd14935ba8cd96a1136ccbf => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:43:34.263443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51c1e7-bf57-4dcb-933a-422e4091e6ff None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:34.263909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51c1e7-bf57-4dcb-933a-422e4091e6ff None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:34.264029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51c1e7-bf57-4dcb-933a-422e4091e6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:34.282211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5a51c1e7-bf57-4dcb-933a-422e4091e6ff None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:34.283416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5a51c1e7-bf57-4dcb-933a-422e4091e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:34.346264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1187/2389] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:43:34.356564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:34.358153 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:34.419104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d1004-6ed2-41db-85db-72478ccbb00c admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:34.422664 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa03b1-bd67-4061-9e44-a041dfcdac00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:34.423318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa03b1-bd67-4061-9e44-a041dfcdac00 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:34.423602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa03b1-bd67-4061-9e44-a041dfcdac00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:34.423879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa03b1-bd67-4061-9e44-a041dfcdac00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:34.433376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa03b1-bd67-4061-9e44-a041dfcdac00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:34.434822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa03b1-bd67-4061-9e44-a041dfcdac00 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:34.445139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1203/2390] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:43:34.978031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51c1e7-bf57-4dcb-933a-422e4091e6ff None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:34.981378 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5a51c1e7-bf57-4dcb-933a-422e4091e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:34.992939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51c1e7-bf57-4dcb-933a-422e4091e6ff None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:34.997620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:34.998594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:34.998884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:34.999162 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] PATH_INFO: `/v3/projects/1cf90de21f274543a4e8d59127cf3723` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:35.000390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf90de21f274543a4e8d59127cf3723)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:35.002478 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:35.133107 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf90de21f274543a4e8d59127cf3723', 'request_id': 'req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:35.139099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf90de21f274543a4e8d59127cf3723', 'request_id': 'req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:35.227784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf90de21f274543a4e8d59127cf3723', 'request_id': 'req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:35.239804 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] The token cache is being invalidate because project 1cf90de21f274543a4e8d59127cf3723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:43:35.240214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:35.240889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:43:35.243036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1188/2391] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:43:34 2022] DELETE /identity/v3/projects/1cf90de21f274543a4e8d59127cf3723 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:43:35.759576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46516cbf-d102-4807-af42-46e2600ee03c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:35.760444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46516cbf-d102-4807-af42-46e2600ee03c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:35.760444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46516cbf-d102-4807-af42-46e2600ee03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:35.778112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-46516cbf-d102-4807-af42-46e2600ee03c None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:43:35.779334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-46516cbf-d102-4807-af42-46e2600ee03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:35.840126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1204/2392] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:43:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:43:35.852908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:43:35.854567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:43:35.860177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:35.931598 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f9e57-dbdd-4434-8eda-05b2f57d59e6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:43:35.936506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a790d-82a7-46bc-81dc-a4cc121012c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:43:35.937156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a790d-82a7-46bc-81dc-a4cc121012c1 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:43:35.937648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a790d-82a7-46bc-81dc-a4cc121012c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:43:35.938229 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a790d-82a7-46bc-81dc-a4cc121012c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:43:35.946715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a790d-82a7-46bc-81dc-a4cc121012c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:43:35.948313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a790d-82a7-46bc-81dc-a4cc121012c1 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:43:35.956872 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1189/2393] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:43:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 17:43:45.833196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:46.003932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=31 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:01.718609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3c7b5-07fe-4f4d-934f-b6b0816cf9b4 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:44:01.719068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3c7b5-07fe-4f4d-934f-b6b0816cf9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:44:01.719068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3c7b5-07fe-4f4d-934f-b6b0816cf9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:44:01.738984 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-e1a3c7b5-07fe-4f4d-934f-b6b0816cf9b4 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:44:01.740223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e1a3c7b5-07fe-4f4d-934f-b6b0816cf9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:44:01.747784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1205/2394] 10.222.0.77 () {58 vars in 967 bytes} [Thu Jun 16 17:44:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:44:01.761865 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a790d-82a7-46bc-81dc-a4cc121012c1 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:44:01.773078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a790d-82a7-46bc-81dc-a4cc121012c1 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:44:01.780592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120267fd-72f4-4d71-aaeb-f63303fccc16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:44:01.781526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120267fd-72f4-4d71-aaeb-f63303fccc16 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:44:01.782065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120267fd-72f4-4d71-aaeb-f63303fccc16 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:44:01.782386 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120267fd-72f4-4d71-aaeb-f63303fccc16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:44:01.795504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120267fd-72f4-4d71-aaeb-f63303fccc16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:44:01.797260 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120267fd-72f4-4d71-aaeb-f63303fccc16 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:44:01.805993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1190/2395] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:44:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 17:44:11.732122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:11.802919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:26.628283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3c7b5-07fe-4f4d-934f-b6b0816cf9b4 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:44:26.629682 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-e1a3c7b5-07fe-4f4d-934f-b6b0816cf9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:44:26.686141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3c7b5-07fe-4f4d-934f-b6b0816cf9b4 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:44:26.689726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09f164-4eb7-4d9c-a100-e9e78d8c1fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:44:26.690364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09f164-4eb7-4d9c-a100-e9e78d8c1fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:44:26.690641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09f164-4eb7-4d9c-a100-e9e78d8c1fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:44:26.690914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09f164-4eb7-4d9c-a100-e9e78d8c1fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:44:26.692697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4b09f164-4eb7-4d9c-a100-e9e78d8c1fa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:44:26.764715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09f164-4eb7-4d9c-a100-e9e78d8c1fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:44:26.766131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09f164-4eb7-4d9c-a100-e9e78d8c1fa3 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:44:26.777643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1206/2396] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:44:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:44:31.099396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120267fd-72f4-4d71-aaeb-f63303fccc16 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:44:31.108662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120267fd-72f4-4d71-aaeb-f63303fccc16 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:44:31.112239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07033548-e64d-48ba-84ea-8decdb67f4bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:44:31.112881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07033548-e64d-48ba-84ea-8decdb67f4bf service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:44:31.113205 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07033548-e64d-48ba-84ea-8decdb67f4bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:44:31.113483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07033548-e64d-48ba-84ea-8decdb67f4bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:44:31.115246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-07033548-e64d-48ba-84ea-8decdb67f4bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:44:31.129213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07033548-e64d-48ba-84ea-8decdb67f4bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:44:31.130624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07033548-e64d-48ba-84ea-8decdb67f4bf service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:44:31.142308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1191/2397] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:44:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:44:36.772150 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=54 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:41.137878 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:43.123500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09f164-4eb7-4d9c-a100-e9e78d8c1fa3 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:44:43.124879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4b09f164-4eb7-4d9c-a100-e9e78d8c1fa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:44:43.139247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09f164-4eb7-4d9c-a100-e9e78d8c1fa3 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:44:43.145146 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee379d4-cf02-4d6b-830e-cdeda4e6e2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:44:43.145803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee379d4-cf02-4d6b-830e-cdeda4e6e2dd service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:44:43.146086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee379d4-cf02-4d6b-830e-cdeda4e6e2dd service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:44:43.146364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee379d4-cf02-4d6b-830e-cdeda4e6e2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:44:43.148209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-bee379d4-cf02-4d6b-830e-cdeda4e6e2dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:44:43.209241 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee379d4-cf02-4d6b-830e-cdeda4e6e2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:44:43.214651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee379d4-cf02-4d6b-830e-cdeda4e6e2dd service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:44:43.222227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1207/2398] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:44:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:44:52.758569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92bef-c477-4884-94db-8d460ef21efc None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:44:52.759119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92bef-c477-4884-94db-8d460ef21efc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:44:52.759119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92bef-c477-4884-94db-8d460ef21efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:44:52.779617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fee92bef-c477-4884-94db-8d460ef21efc None None] MFA Rules not processed for user `f814a06f54894fa2992d3ba3be21b4db`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:44:52.780993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fee92bef-c477-4884-94db-8d460ef21efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:44:52.789119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1192/2399] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:44:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:44:53.217778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=28 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:59.286335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee379d4-cf02-4d6b-830e-cdeda4e6e2dd service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:44:59.300162 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee379d4-cf02-4d6b-830e-cdeda4e6e2dd service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:44:59.306130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e8ce-5795-44a7-a8ed-fd5219f1d9a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:44:59.306895 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e8ce-5795-44a7-a8ed-fd5219f1d9a0 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:44:59.307250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e8ce-5795-44a7-a8ed-fd5219f1d9a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:44:59.310007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e8ce-5795-44a7-a8ed-fd5219f1d9a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:44:59.310917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-2a20e8ce-5795-44a7-a8ed-fd5219f1d9a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:44:59.323890 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20e8ce-5795-44a7-a8ed-fd5219f1d9a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:44:59.325553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20e8ce-5795-44a7-a8ed-fd5219f1d9a0 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:44:59.336838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1208/2400] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:44:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:44:59.426599 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92bef-c477-4884-94db-8d460ef21efc None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:44:59.428293 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fee92bef-c477-4884-94db-8d460ef21efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:44:59.503631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92bef-c477-4884-94db-8d460ef21efc None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:44:59.507247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac757138-df0c-4d73-a99c-780efe6e1c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:44:59.507903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757138-df0c-4d73-a99c-780efe6e1c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:44:59.508228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757138-df0c-4d73-a99c-780efe6e1c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:44:59.508510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757138-df0c-4d73-a99c-780efe6e1c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:44:59.510460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ac757138-df0c-4d73-a99c-780efe6e1c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:44:59.520996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac757138-df0c-4d73-a99c-780efe6e1c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:44:59.522437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac757138-df0c-4d73-a99c-780efe6e1c1f service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:44:59.541002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1193/2401] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:44:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:45:09.332045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=6 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:09.527383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=29 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:14.031930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e8ce-5795-44a7-a8ed-fd5219f1d9a0 service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:45:14.033445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-2a20e8ce-5795-44a7-a8ed-fd5219f1d9a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:45:14.047165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e8ce-5795-44a7-a8ed-fd5219f1d9a0 service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:45:14.052670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fac8c-52ce-42e7-8ddc-8c2c25a23f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:45:14.053308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fac8c-52ce-42e7-8ddc-8c2c25a23f61 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:45:14.053705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fac8c-52ce-42e7-8ddc-8c2c25a23f61 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:45:14.053990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fac8c-52ce-42e7-8ddc-8c2c25a23f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:45:14.055692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9d6fac8c-52ce-42e7-8ddc-8c2c25a23f61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:45:14.116568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fac8c-52ce-42e7-8ddc-8c2c25a23f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:45:14.118058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fac8c-52ce-42e7-8ddc-8c2c25a23f61 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:45:14.127441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1209/2402] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:45:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:45:17.644826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac757138-df0c-4d73-a99c-780efe6e1c1f service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:45:17.659644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac757138-df0c-4d73-a99c-780efe6e1c1f service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:45:17.665305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829017e-4d4a-4ae2-91a1-c5fff3884856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:45:17.666282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829017e-4d4a-4ae2-91a1-c5fff3884856 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:45:17.666635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829017e-4d4a-4ae2-91a1-c5fff3884856 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:45:17.666985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829017e-4d4a-4ae2-91a1-c5fff3884856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:45:17.669489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9829017e-4d4a-4ae2-91a1-c5fff3884856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:45:17.682533 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829017e-4d4a-4ae2-91a1-c5fff3884856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:45:17.684280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829017e-4d4a-4ae2-91a1-c5fff3884856 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:45:17.695728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1194/2403] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:45:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:45:20.864848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fac8c-52ce-42e7-8ddc-8c2c25a23f61 service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:45:20.877386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fac8c-52ce-42e7-8ddc-8c2c25a23f61 service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:45:20.884447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0e4a8-2afe-49bb-9542-6163c03cd650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:45:20.885352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0e4a8-2afe-49bb-9542-6163c03cd650 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:45:20.886114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0e4a8-2afe-49bb-9542-6163c03cd650 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:45:20.886463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0e4a8-2afe-49bb-9542-6163c03cd650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:45:20.889577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-58e0e4a8-2afe-49bb-9542-6163c03cd650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:45:20.953746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0e4a8-2afe-49bb-9542-6163c03cd650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:45:20.955385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0e4a8-2afe-49bb-9542-6163c03cd650 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:45:20.964730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1210/2404] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:45:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:45:27.690924 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:30.960338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=56 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:33.571474 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c726-fdc9-4ebb-a617-fada15d717ef None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:45:33.571981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c726-fdc9-4ebb-a617-fada15d717ef None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:45:33.572135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41c726-fdc9-4ebb-a617-fada15d717ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:45:33.591272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-4e41c726-fdc9-4ebb-a617-fada15d717ef None None] MFA Rules not processed for user `97e53b295eb24d558023b8a120dad771`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:45:33.596542 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4e41c726-fdc9-4ebb-a617-fada15d717ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:45:33.599710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1195/2405] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:45:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:45:34.091139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0e4a8-2afe-49bb-9542-6163c03cd650 service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:45:34.100432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0e4a8-2afe-49bb-9542-6163c03cd650 service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:45:34.104507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575b27d-ccbe-4b3f-a107-300757433f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:45:34.105358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b27d-ccbe-4b3f-a107-300757433f54 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:45:34.106003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b27d-ccbe-4b3f-a107-300757433f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:45:34.106214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b27d-ccbe-4b3f-a107-300757433f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:45:34.107964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3575b27d-ccbe-4b3f-a107-300757433f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:45:34.118211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575b27d-ccbe-4b3f-a107-300757433f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:45:34.119651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575b27d-ccbe-4b3f-a107-300757433f54 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:45:34.128847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1211/2406] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:45:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:45:34.663566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41c726-fdc9-4ebb-a617-fada15d717ef None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:45:34.665041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4e41c726-fdc9-4ebb-a617-fada15d717ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:45:34.739368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41c726-fdc9-4ebb-a617-fada15d717ef None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:45:34.744370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff979e8-7301-4afd-959d-dd972e845d71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:45:34.745022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff979e8-7301-4afd-959d-dd972e845d71 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:45:34.745303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff979e8-7301-4afd-959d-dd972e845d71 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:45:34.745576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff979e8-7301-4afd-959d-dd972e845d71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:45:34.747900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3ff979e8-7301-4afd-959d-dd972e845d71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:45:34.759163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff979e8-7301-4afd-959d-dd972e845d71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:45:34.760756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff979e8-7301-4afd-959d-dd972e845d71 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:45:34.771057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1196/2407] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:45:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:45:34.974701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1073d-fb60-4407-be77-438db64960b7 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:45:34.974923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1073d-fb60-4407-be77-438db64960b7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:45:34.975230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1073d-fb60-4407-be77-438db64960b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:45:34.992769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-aac1073d-fb60-4407-be77-438db64960b7 None None] MFA Rules not processed for user `65a3da0b77fd473584f7e356c05890a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:45:34.994005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-aac1073d-fb60-4407-be77-438db64960b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:45:35.002412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1212/2408] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:45:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:45:44.766961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=35 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:44.987636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=9 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:45:45.858256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff979e8-7301-4afd-959d-dd972e845d71 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:45:45.871229 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff979e8-7301-4afd-959d-dd972e845d71 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:45:45.876996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fd7ca-c22a-41a9-9a53-4204ba242867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:45:45.877645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fd7ca-c22a-41a9-9a53-4204ba242867 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:45:45.877926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fd7ca-c22a-41a9-9a53-4204ba242867 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:45:45.878203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fd7ca-c22a-41a9-9a53-4204ba242867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:45:45.879971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9c8fd7ca-c22a-41a9-9a53-4204ba242867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:45:45.896866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fd7ca-c22a-41a9-9a53-4204ba242867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:45:45.896866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fd7ca-c22a-41a9-9a53-4204ba242867 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:45:45.906890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1197/2409] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:45:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:45:55.901292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:32.873694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8c42-a2ea-4db8-b8f5-af30f2ee7bac None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:32.873694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8c42-a2ea-4db8-b8f5-af30f2ee7bac None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:32.873694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b8c42-a2ea-4db8-b8f5-af30f2ee7bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:32.891480 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-998b8c42-a2ea-4db8-b8f5-af30f2ee7bac None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:46:32.892727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-998b8c42-a2ea-4db8-b8f5-af30f2ee7bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:32.900227 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1213/2410] 10.222.0.77 () {58 vars in 967 bytes} [Thu Jun 16 17:46:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:46:33.051877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fd7ca-c22a-41a9-9a53-4204ba242867 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:33.064032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fd7ca-c22a-41a9-9a53-4204ba242867 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:33.069315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e62b0d-042d-46c0-9fe7-c80b16284f82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:33.069970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e62b0d-042d-46c0-9fe7-c80b16284f82 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:33.070256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e62b0d-042d-46c0-9fe7-c80b16284f82 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:33.070566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e62b0d-042d-46c0-9fe7-c80b16284f82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:33.080575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e62b0d-042d-46c0-9fe7-c80b16284f82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:33.082157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e62b0d-042d-46c0-9fe7-c80b16284f82 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:33.092059 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1198/2411] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:46:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:46:33.233022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b8c42-a2ea-4db8-b8f5-af30f2ee7bac None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:33.234505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-998b8c42-a2ea-4db8-b8f5-af30f2ee7bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:33.247374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b8c42-a2ea-4db8-b8f5-af30f2ee7bac None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:33.250994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c23b13-2bf5-466e-a6f0-7378a379757e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:33.251641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c23b13-2bf5-466e-a6f0-7378a379757e service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:33.252019 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c23b13-2bf5-466e-a6f0-7378a379757e service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:33.252332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c23b13-2bf5-466e-a6f0-7378a379757e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:33.254122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c5c23b13-2bf5-466e-a6f0-7378a379757e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:33.319412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c23b13-2bf5-466e-a6f0-7378a379757e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:33.321010 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c23b13-2bf5-466e-a6f0-7378a379757e service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:33.332305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1214/2412] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:46:37.066236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e62b0d-042d-46c0-9fe7-c80b16284f82 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:37.067698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d8e62b0d-042d-46c0-9fe7-c80b16284f82 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:37.082546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e62b0d-042d-46c0-9fe7-c80b16284f82 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:37.087675 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d8538-33fa-46ae-88bb-1a9594b03fea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:37.088351 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d8538-33fa-46ae-88bb-1a9594b03fea service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:37.088635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d8538-33fa-46ae-88bb-1a9594b03fea service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:37.088910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d8538-33fa-46ae-88bb-1a9594b03fea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:37.091631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2b6d8538-33fa-46ae-88bb-1a9594b03fea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:37.103266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d8538-33fa-46ae-88bb-1a9594b03fea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:37.104918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d8538-33fa-46ae-88bb-1a9594b03fea service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:37.116338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1199/2413] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:46:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:46:37.191920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c23b13-2bf5-466e-a6f0-7378a379757e service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:37.194225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c5c23b13-2bf5-466e-a6f0-7378a379757e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:37.211118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c23b13-2bf5-466e-a6f0-7378a379757e service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:37.218624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:37.219775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:37.220435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:37.220868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] PATH_INFO: `/v3/users/f814a06f54894fa2992d3ba3be21b4db` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:37.222498 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f814a06f54894fa2992d3ba3be21b4db)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:37.225106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:37.450162 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f814a06f54894fa2992d3ba3be21b4db'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:37.462106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f814a06f54894fa2992d3ba3be21b4db'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:37.577782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f814a06f54894fa2992d3ba3be21b4db'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:37.578779 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f814a06f54894fa2992d3ba3be21b4db'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:37.579740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f814a06f54894fa2992d3ba3be21b4db'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:37.595828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1215/2414] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:46:37 2022] DELETE /identity/v3/users/f814a06f54894fa2992d3ba3be21b4db => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:46:37.939470 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d8538-33fa-46ae-88bb-1a9594b03fea service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:37.967036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d8538-33fa-46ae-88bb-1a9594b03fea service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:38.092857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:38.096679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:38.096679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:38.096679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] PATH_INFO: `/v3/projects/fc2020c863b74fcf914fe647b64fba63` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:38.096679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2020c863b74fcf914fe647b64fba63)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:38.098070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:38.212756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:38.214383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:38.232877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2020c863b74fcf914fe647b64fba63', 'request_id': 'req-f325e071-2324-4ca0-b77b-d2388e3eb14d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:38.239771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2020c863b74fcf914fe647b64fba63', 'request_id': 'req-f325e071-2324-4ca0-b77b-d2388e3eb14d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:38.305076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:38.312410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d17a9-4c5e-4a39-9ec9-0acabc586dae admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:38.332540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2020c863b74fcf914fe647b64fba63', 'request_id': 'req-f325e071-2324-4ca0-b77b-d2388e3eb14d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:38.350216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] The token cache is being invalidate because project fc2020c863b74fcf914fe647b64fba63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:46:38.350500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:38.351176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f325e071-2324-4ca0-b77b-d2388e3eb14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:38.352762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1200/2415] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:46:37 2022] DELETE /identity/v3/projects/fc2020c863b74fcf914fe647b64fba63 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:46:38.358644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fdbc-1c9e-4c08-865a-688eb37fa406 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:38.358935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fdbc-1c9e-4c08-865a-688eb37fa406 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:38.360296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fdbc-1c9e-4c08-865a-688eb37fa406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:38.388499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e7ee5-9ae8-4c62-8a04-0c80cd3b9cb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:38.389217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7ee5-9ae8-4c62-8a04-0c80cd3b9cb2 service placement] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:38.397925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7ee5-9ae8-4c62-8a04-0c80cd3b9cb2 service placement] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:38.397925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7ee5-9ae8-4c62-8a04-0c80cd3b9cb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:38.397925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-677e7ee5-9ae8-4c62-8a04-0c80cd3b9cb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:38.398427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9cf0fdbc-1c9e-4c08-865a-688eb37fa406 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:46:38.398427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9cf0fdbc-1c9e-4c08-865a-688eb37fa406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:38.405164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e7ee5-9ae8-4c62-8a04-0c80cd3b9cb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:38.407733 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e7ee5-9ae8-4c62-8a04-0c80cd3b9cb2 service placement] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:38.421446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1216/2416] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:46:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:46:38.469014 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1201/2417] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:46:38.477083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc8684-bb88-4809-ba79-fd99c39111fd None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:38.477368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc8684-bb88-4809-ba79-fd99c39111fd None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:38.477643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc8684-bb88-4809-ba79-fd99c39111fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:38.497054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-40bc8684-bb88-4809-ba79-fd99c39111fd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:46:38.498294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-40bc8684-bb88-4809-ba79-fd99c39111fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:38.506500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1217/2418] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:46:38.510959 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0fdbc-1c9e-4c08-865a-688eb37fa406 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:38.517722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:38.521656 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0fdbc-1c9e-4c08-865a-688eb37fa406 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:38.527039 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa522cf7-2049-4787-96ba-390ef676fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:38.528422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522cf7-2049-4787-96ba-390ef676fd54 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:38.528706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522cf7-2049-4787-96ba-390ef676fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:38.529833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522cf7-2049-4787-96ba-390ef676fd54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:38.529833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa522cf7-2049-4787-96ba-390ef676fd54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:46:38.530031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa522cf7-2049-4787-96ba-390ef676fd54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:38.531655 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa522cf7-2049-4787-96ba-390ef676fd54 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:38.549388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1202/2419] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:46:38.553916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc8684-bb88-4809-ba79-fd99c39111fd None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:38.565228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc8684-bb88-4809-ba79-fd99c39111fd None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:38.570182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0f947-fb07-422d-9630-d16d4ed50805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:38.570856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0f947-fb07-422d-9630-d16d4ed50805 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:38.571139 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0f947-fb07-422d-9630-d16d4ed50805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:38.571611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0f947-fb07-422d-9630-d16d4ed50805 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:38.575926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0f947-fb07-422d-9630-d16d4ed50805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:38.578269 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0f947-fb07-422d-9630-d16d4ed50805 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:38.772449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1218/2420] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:46:38 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:46:38.773799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa522cf7-2049-4787-96ba-390ef676fd54 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:38.785526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa522cf7-2049-4787-96ba-390ef676fd54 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:38.852341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e1ac7-71c1-4e27-827a-9488cbd291ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:38.853241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e1ac7-71c1-4e27-827a-9488cbd291ba admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:38.853529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e1ac7-71c1-4e27-827a-9488cbd291ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:38.853809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e1ac7-71c1-4e27-827a-9488cbd291ba admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:38.854592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e1ac7-71c1-4e27-827a-9488cbd291ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:38.857805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e1ac7-71c1-4e27-827a-9488cbd291ba admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:38.942908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1203/2421] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:46:38 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:46:38.944254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0f947-fb07-422d-9630-d16d4ed50805 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:38.955225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0f947-fb07-422d-9630-d16d4ed50805 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:38.960264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32abdea-1ed8-4dc9-b493-9193ebc36edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:38.961085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32abdea-1ed8-4dc9-b493-9193ebc36edc admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:38.961464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32abdea-1ed8-4dc9-b493-9193ebc36edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:38.961818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32abdea-1ed8-4dc9-b493-9193ebc36edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:38.962821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32abdea-1ed8-4dc9-b493-9193ebc36edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:38.964740 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32abdea-1ed8-4dc9-b493-9193ebc36edc admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:38.977170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1219/2422] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:46:38.987477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e1ac7-71c1-4e27-827a-9488cbd291ba admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:38.998662 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e1ac7-71c1-4e27-827a-9488cbd291ba admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:39.003369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4787d7-6f60-4d6c-90f5-950b8ae729fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:39.004045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4787d7-6f60-4d6c-90f5-950b8ae729fc admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:39.004355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4787d7-6f60-4d6c-90f5-950b8ae729fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:39.004635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4787d7-6f60-4d6c-90f5-950b8ae729fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:39.005363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4787d7-6f60-4d6c-90f5-950b8ae729fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:39.006967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4787d7-6f60-4d6c-90f5-950b8ae729fc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:39.017819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1204/2423] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:46:39.022098 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32abdea-1ed8-4dc9-b493-9193ebc36edc admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:39.032708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32abdea-1ed8-4dc9-b493-9193ebc36edc admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:39.037401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4b962-36f3-4b71-9b81-a089ad6ce37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:39.038297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4b962-36f3-4b71-9b81-a089ad6ce37e admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:39.038578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4b962-36f3-4b71-9b81-a089ad6ce37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:39.038854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4b962-36f3-4b71-9b81-a089ad6ce37e admin admin] PATH_INFO: `/v3/projects/075db4ca21b445018e8f05df1a81a07e/users/0b0a56714bbc470d93d6761d1757d448/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:39.055993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4b962-36f3-4b71-9b81-a089ad6ce37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=075db4ca21b445018e8f05df1a81a07e, user_id=0b0a56714bbc470d93d6761d1757d448, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:39.059396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4b962-36f3-4b71-9b81-a089ad6ce37e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:39.167216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1220/2424] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:46:39 2022] PUT /identity/v3/projects/075db4ca21b445018e8f05df1a81a07e/users/0b0a56714bbc470d93d6761d1757d448/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:46:39.173007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1a03d-91d9-41e3-8f46-ab187e1b0eb3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:39.173490 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1a03d-91d9-41e3-8f46-ab187e1b0eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:39.173712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1a03d-91d9-41e3-8f46-ab187e1b0eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:39.192310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b0b1a03d-91d9-41e3-8f46-ab187e1b0eb3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:46:39.193614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b0b1a03d-91d9-41e3-8f46-ab187e1b0eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:39.257956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1205/2425] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:46:39.268295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4b962-36f3-4b71-9b81-a089ad6ce37e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:39.270046 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8fe4b962-36f3-4b71-9b81-a089ad6ce37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:39.331986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4b962-36f3-4b71-9b81-a089ad6ce37e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:39.335836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34dcff-8497-40fc-afb6-db0bbc1981a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:39.336526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34dcff-8497-40fc-afb6-db0bbc1981a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:39.336808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34dcff-8497-40fc-afb6-db0bbc1981a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:39.337083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34dcff-8497-40fc-afb6-db0bbc1981a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:39.347982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34dcff-8497-40fc-afb6-db0bbc1981a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:39.349455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34dcff-8497-40fc-afb6-db0bbc1981a8 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:39.360295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1221/2426] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:46:42.783286 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1a03d-91d9-41e3-8f46-ab187e1b0eb3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:42.784935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b0b1a03d-91d9-41e3-8f46-ab187e1b0eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:42.799615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1a03d-91d9-41e3-8f46-ab187e1b0eb3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:42.807220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:42.808330 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:42.809472 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:42.809869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] PATH_INFO: `/v3/users/b26d3bc7b17b4ec79a6bff51ccdf1bee` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:42.811655 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b26d3bc7b17b4ec79a6bff51ccdf1bee)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:42.813919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:43.068520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b26d3bc7b17b4ec79a6bff51ccdf1bee'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:43.099098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b26d3bc7b17b4ec79a6bff51ccdf1bee'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:43.103512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:43.178801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b26d3bc7b17b4ec79a6bff51ccdf1bee'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:43.179773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b26d3bc7b17b4ec79a6bff51ccdf1bee'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:43.182910 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b26d3bc7b17b4ec79a6bff51ccdf1bee'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:43.203855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1206/2427] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:46:42 2022] DELETE /identity/v3/users/b26d3bc7b17b4ec79a6bff51ccdf1bee => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:46:43.460494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34dcff-8497-40fc-afb6-db0bbc1981a8 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:43.471088 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34dcff-8497-40fc-afb6-db0bbc1981a8 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:43.495064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:43.535050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:43.535910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:43.536254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:43.536564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] PATH_INFO: `/v3/projects/1c0d4324288e41c4ab5c4b24a7f3cfbd` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:43.537696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0d4324288e41c4ab5c4b24a7f3cfbd)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:43.539590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:43.677653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0d4324288e41c4ab5c4b24a7f3cfbd', 'request_id': 'req-78a15392-9227-459d-9c0e-f7c1d4b59927'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:43.687774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0d4324288e41c4ab5c4b24a7f3cfbd', 'request_id': 'req-78a15392-9227-459d-9c0e-f7c1d4b59927'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:43.695015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0d4324288e41c4ab5c4b24a7f3cfbd', 'request_id': 'req-78a15392-9227-459d-9c0e-f7c1d4b59927'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:43.773190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] The token cache is being invalidate because project 1c0d4324288e41c4ab5c4b24a7f3cfbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:46:43.773595 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:43.774520 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:43.776662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1222/2428] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:46:43 2022] DELETE /identity/v3/projects/1c0d4324288e41c4ab5c4b24a7f3cfbd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:46:43.780737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:43.782651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:43.797447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c919da8-228a-4d84-9718-a2877ebd32ac admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:43.875100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:43.876007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:43.876344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:43.876626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] PATH_INFO: `/v3/users/4ff783fe5acd4ba485061cfb681db34f` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:43.877843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff783fe5acd4ba485061cfb681db34f)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:43.879812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:44.037123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff783fe5acd4ba485061cfb681db34f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:44.061342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff783fe5acd4ba485061cfb681db34f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:44.107842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff783fe5acd4ba485061cfb681db34f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:44.108629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff783fe5acd4ba485061cfb681db34f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:44.109296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cb944474-6cc0-4bf2-bdba-575fd0e463ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff783fe5acd4ba485061cfb681db34f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:44.127958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1207/2429] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:46:43 2022] DELETE /identity/v3/users/4ff783fe5acd4ba485061cfb681db34f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:46:44.412407 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:44.414439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:44.429730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15392-9227-459d-9c0e-f7c1d4b59927 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:44.521715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:44.522621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:44.522902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:44.523396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] PATH_INFO: `/v3/projects/40097c6e5e334edeb86d2e50fbdf9933` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:44.524757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40097c6e5e334edeb86d2e50fbdf9933)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:44.528089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:44.675988 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40097c6e5e334edeb86d2e50fbdf9933', 'request_id': 'req-0c7059f7-6139-4b07-9f5d-e472cef9067c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:44.682731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:44.700840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40097c6e5e334edeb86d2e50fbdf9933', 'request_id': 'req-0c7059f7-6139-4b07-9f5d-e472cef9067c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:44.721243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40097c6e5e334edeb86d2e50fbdf9933', 'request_id': 'req-0c7059f7-6139-4b07-9f5d-e472cef9067c'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:44.853219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] The token cache is being invalidate because project 40097c6e5e334edeb86d2e50fbdf9933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:46:44.853787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:44.854866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0c7059f7-6139-4b07-9f5d-e472cef9067c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:46:44.860924 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1223/2430] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:46:44 2022] DELETE /identity/v3/projects/40097c6e5e334edeb86d2e50fbdf9933 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:46:44.863413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79359c81-49d0-4e10-806c-231d09d5c37f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:44.864286 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79359c81-49d0-4e10-806c-231d09d5c37f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:44.864573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79359c81-49d0-4e10-806c-231d09d5c37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:44.890913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-79359c81-49d0-4e10-806c-231d09d5c37f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:46:44.892217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-79359c81-49d0-4e10-806c-231d09d5c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:44.965783 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1208/2431] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:46:44.973884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6a4de-f436-4857-b422-6025e0aa5707 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:44.974692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6a4de-f436-4857-b422-6025e0aa5707 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:44.975128 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6a4de-f436-4857-b422-6025e0aa5707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:45.004991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-0db6a4de-f436-4857-b422-6025e0aa5707 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:46:45.006697 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0db6a4de-f436-4857-b422-6025e0aa5707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:45.016298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1224/2432] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:46:45.020370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79359c81-49d0-4e10-806c-231d09d5c37f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:45.026423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:45.034335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79359c81-49d0-4e10-806c-231d09d5c37f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:45.040085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77894-7776-48a6-bdb2-ae6292211df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:45.040969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77894-7776-48a6-bdb2-ae6292211df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:45.041458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77894-7776-48a6-bdb2-ae6292211df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:45.044398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77894-7776-48a6-bdb2-ae6292211df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:45.044398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc77894-7776-48a6-bdb2-ae6292211df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:46:45.044398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc77894-7776-48a6-bdb2-ae6292211df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:45.046144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc77894-7776-48a6-bdb2-ae6292211df2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:45.060206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1209/2433] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:46:45.068962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6a4de-f436-4857-b422-6025e0aa5707 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:45.080143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6a4de-f436-4857-b422-6025e0aa5707 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:45.085232 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f295-6fd5-40df-b52f-bfddabedbc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:45.086263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f295-6fd5-40df-b52f-bfddabedbc29 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:45.086263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f295-6fd5-40df-b52f-bfddabedbc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:45.086521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f295-6fd5-40df-b52f-bfddabedbc29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:45.087652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f295-6fd5-40df-b52f-bfddabedbc29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:45.089379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f295-6fd5-40df-b52f-bfddabedbc29 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:45.185330 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1225/2434] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:46:45 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:46:45.186379 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77894-7776-48a6-bdb2-ae6292211df2 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:45.198129 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77894-7776-48a6-bdb2-ae6292211df2 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:45.274132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1142c6-43ed-49c0-a306-c081249f6113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:45.275036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1142c6-43ed-49c0-a306-c081249f6113 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:45.275242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1142c6-43ed-49c0-a306-c081249f6113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:45.275453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1142c6-43ed-49c0-a306-c081249f6113 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:45.276182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1142c6-43ed-49c0-a306-c081249f6113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:45.278988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1142c6-43ed-49c0-a306-c081249f6113 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:45.407983 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f295-6fd5-40df-b52f-bfddabedbc29 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:45.410022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1210/2435] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:46:45 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:46:45.426373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f295-6fd5-40df-b52f-bfddabedbc29 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:45.433213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211b24a-b550-4bcb-b3a6-efe910e9df23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:45.434079 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211b24a-b550-4bcb-b3a6-efe910e9df23 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:45.434366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211b24a-b550-4bcb-b3a6-efe910e9df23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:45.434702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211b24a-b550-4bcb-b3a6-efe910e9df23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:45.435431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211b24a-b550-4bcb-b3a6-efe910e9df23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:45.437309 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211b24a-b550-4bcb-b3a6-efe910e9df23 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:45.459294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1226/2436] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:46:45.460581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1142c6-43ed-49c0-a306-c081249f6113 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:45.474543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1142c6-43ed-49c0-a306-c081249f6113 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:45.487458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498264ea-bcfc-4162-a0fa-5ee4eb66e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:45.488847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498264ea-bcfc-4162-a0fa-5ee4eb66e712 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:45.489363 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498264ea-bcfc-4162-a0fa-5ee4eb66e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:45.489803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498264ea-bcfc-4162-a0fa-5ee4eb66e712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:45.491625 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498264ea-bcfc-4162-a0fa-5ee4eb66e712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:45.493829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498264ea-bcfc-4162-a0fa-5ee4eb66e712 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:45.511056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1211/2437] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:46:45.513040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211b24a-b550-4bcb-b3a6-efe910e9df23 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:45.527840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211b24a-b550-4bcb-b3a6-efe910e9df23 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:45.534243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aaca0-1fcc-47d8-b4a8-dc4563bdc963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:45.535347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aaca0-1fcc-47d8-b4a8-dc4563bdc963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:45.535803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aaca0-1fcc-47d8-b4a8-dc4563bdc963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:45.536599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aaca0-1fcc-47d8-b4a8-dc4563bdc963 admin admin] PATH_INFO: `/v3/projects/564a4a11032e43ffa93421e9ff96ddec/users/01866477c9d04ffc87c126508ecaf0e4/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:45.561386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1aaca0-1fcc-47d8-b4a8-dc4563bdc963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564a4a11032e43ffa93421e9ff96ddec, user_id=01866477c9d04ffc87c126508ecaf0e4, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:45.564290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1aaca0-1fcc-47d8-b4a8-dc4563bdc963 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:45.635382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1227/2438] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:46:45 2022] PUT /identity/v3/projects/564a4a11032e43ffa93421e9ff96ddec/users/01866477c9d04ffc87c126508ecaf0e4/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:46:45.637160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a39d-82fc-4859-a150-75d540ddc4c3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:45.637455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a39d-82fc-4859-a150-75d540ddc4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:45.638327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a39d-82fc-4859-a150-75d540ddc4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:45.659655 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8780a39d-82fc-4859-a150-75d540ddc4c3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:46:45.661140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8780a39d-82fc-4859-a150-75d540ddc4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:45.684657 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863fd2-bf1c-4b46-93d3-13d37ee18106 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:45.688816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863fd2-bf1c-4b46-93d3-13d37ee18106 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:45.689325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863fd2-bf1c-4b46-93d3-13d37ee18106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:45.758199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3c863fd2-bf1c-4b46-93d3-13d37ee18106 None None] MFA Rules not processed for user `0b0a56714bbc470d93d6761d1757d448`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:46:45.759454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3c863fd2-bf1c-4b46-93d3-13d37ee18106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:45.803394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1212/2439] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:46:45.814124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a39d-82fc-4859-a150-75d540ddc4c3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:45.816112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8780a39d-82fc-4859-a150-75d540ddc4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:45.858728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1228/2440] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:46:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:46:45.881413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863fd2-bf1c-4b46-93d3-13d37ee18106 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:45.889342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3c863fd2-bf1c-4b46-93d3-13d37ee18106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:45.908605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a39d-82fc-4859-a150-75d540ddc4c3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:45.914191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c556c-a110-4b31-9bb7-486b7eda8f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:45.914862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c556c-a110-4b31-9bb7-486b7eda8f56 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:45.915146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c556c-a110-4b31-9bb7-486b7eda8f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:45.915426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c556c-a110-4b31-9bb7-486b7eda8f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:45.929228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c556c-a110-4b31-9bb7-486b7eda8f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:45.931117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c556c-a110-4b31-9bb7-486b7eda8f56 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:45.948369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1213/2441] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:46:45.986908 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863fd2-bf1c-4b46-93d3-13d37ee18106 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:45.994297 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f872e5e-e978-425f-b805-43bc0b3852b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:45.995481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f872e5e-e978-425f-b805-43bc0b3852b8 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:45.996047 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f872e5e-e978-425f-b805-43bc0b3852b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:45.996600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f872e5e-e978-425f-b805-43bc0b3852b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:46.002667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:46.007495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f872e5e-e978-425f-b805-43bc0b3852b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:46.009315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f872e5e-e978-425f-b805-43bc0b3852b8 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:46.020884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1229/2442] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:46:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:46:49.863535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1c8e4-e512-4c7d-8073-c4cb3d336191 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:49.864580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1c8e4-e512-4c7d-8073-c4cb3d336191 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:49.864869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1c8e4-e512-4c7d-8073-c4cb3d336191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:49.886292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-53e1c8e4-e512-4c7d-8073-c4cb3d336191 None None] MFA Rules not processed for user `0b0a56714bbc470d93d6761d1757d448`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:46:49.887980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-53e1c8e4-e512-4c7d-8073-c4cb3d336191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:49.899279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1214/2443] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:46:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:46:53.320544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6a8f1-d237-4f39-aa99-e21584a31c67 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:53.321122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6a8f1-d237-4f39-aa99-e21584a31c67 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:53.321122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6a8f1-d237-4f39-aa99-e21584a31c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:53.372544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-34f6a8f1-d237-4f39-aa99-e21584a31c67 None None] MFA Rules not processed for user `01866477c9d04ffc87c126508ecaf0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:46:53.372544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-34f6a8f1-d237-4f39-aa99-e21584a31c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:46:53.434598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1230/2444] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:46:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:46:53.439382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1c8e4-e512-4c7d-8073-c4cb3d336191 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:53.446755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:46:53.452987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1c8e4-e512-4c7d-8073-c4cb3d336191 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:53.458580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2fffe-d0a7-40fd-8bf7-414fe2370d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:53.459283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2fffe-d0a7-40fd-8bf7-414fe2370d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:53.459565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2fffe-d0a7-40fd-8bf7-414fe2370d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:53.459841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2fffe-d0a7-40fd-8bf7-414fe2370d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:53.460571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2fffe-d0a7-40fd-8bf7-414fe2370d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:53.462520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2fffe-d0a7-40fd-8bf7-414fe2370d12 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:53.594283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1215/2445] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:46:53 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:46:53.598383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6a8f1-d237-4f39-aa99-e21584a31c67 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:53.611340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6a8f1-d237-4f39-aa99-e21584a31c67 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:53.670218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b213b-c697-4707-a5b1-7d586a8b3f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:53.670898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b213b-c697-4707-a5b1-7d586a8b3f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:53.671181 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b213b-c697-4707-a5b1-7d586a8b3f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:53.671455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b213b-c697-4707-a5b1-7d586a8b3f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:53.672169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b213b-c697-4707-a5b1-7d586a8b3f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:53.674130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b213b-c697-4707-a5b1-7d586a8b3f68 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:53.819291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1231/2446] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:46:53 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:46:53.823105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2fffe-d0a7-40fd-8bf7-414fe2370d12 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:53.834010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2fffe-d0a7-40fd-8bf7-414fe2370d12 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:53.838491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d4d41-7e95-4dd5-bfc0-a2fb395c040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:53.839705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d4d41-7e95-4dd5-bfc0-a2fb395c040b admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:53.839981 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d4d41-7e95-4dd5-bfc0-a2fb395c040b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:53.840419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d4d41-7e95-4dd5-bfc0-a2fb395c040b admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:53.841131 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d4d41-7e95-4dd5-bfc0-a2fb395c040b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:53.842785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d4d41-7e95-4dd5-bfc0-a2fb395c040b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:53.852956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1216/2447] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:46:53.859287 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b213b-c697-4707-a5b1-7d586a8b3f68 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:53.870040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b213b-c697-4707-a5b1-7d586a8b3f68 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:53.875368 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bd209-fd3e-4a0c-a714-4f3b2c5997fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:53.876286 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd209-fd3e-4a0c-a714-4f3b2c5997fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:53.876566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd209-fd3e-4a0c-a714-4f3b2c5997fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:53.876838 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd209-fd3e-4a0c-a714-4f3b2c5997fb admin admin] PATH_INFO: `/v3/projects/5466dad56dbb455cac62d883774f3d8c/users/ace680dd9b6c493fa60aef465623ca5e/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:53.894016 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bd209-fd3e-4a0c-a714-4f3b2c5997fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5466dad56dbb455cac62d883774f3d8c, user_id=ace680dd9b6c493fa60aef465623ca5e, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:53.896858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bd209-fd3e-4a0c-a714-4f3b2c5997fb admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:53.986844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1232/2448] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:46:53 2022] PUT /identity/v3/projects/5466dad56dbb455cac62d883774f3d8c/users/ace680dd9b6c493fa60aef465623ca5e/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:46:53.987101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d4d41-7e95-4dd5-bfc0-a2fb395c040b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:53.999491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d4d41-7e95-4dd5-bfc0-a2fb395c040b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:54.107200 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01526f70-7322-4d09-801a-c0ba8d9823b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:54.107929 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526f70-7322-4d09-801a-c0ba8d9823b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:54.108413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526f70-7322-4d09-801a-c0ba8d9823b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:54.108841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526f70-7322-4d09-801a-c0ba8d9823b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:54.110206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01526f70-7322-4d09-801a-c0ba8d9823b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:54.112096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01526f70-7322-4d09-801a-c0ba8d9823b3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:54.131117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1217/2449] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:46:54.135112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bd209-fd3e-4a0c-a714-4f3b2c5997fb admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:46:54.146648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bd209-fd3e-4a0c-a714-4f3b2c5997fb admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:46:54.152808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97200df2-4876-4b95-8f88-d673a7fad453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:46:54.153916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97200df2-4876-4b95-8f88-d673a7fad453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:46:54.154271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97200df2-4876-4b95-8f88-d673a7fad453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:46:54.154618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97200df2-4876-4b95-8f88-d673a7fad453 admin admin] PATH_INFO: `/v3/projects/5466dad56dbb455cac62d883774f3d8c/users/ace680dd9b6c493fa60aef465623ca5e/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:46:54.157125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97200df2-4876-4b95-8f88-d673a7fad453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5466dad56dbb455cac62d883774f3d8c, user_id=ace680dd9b6c493fa60aef465623ca5e, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:46:54.159718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97200df2-4876-4b95-8f88-d673a7fad453 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:46:54.182332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1233/2450] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:46:54 2022] PUT /identity/v3/projects/5466dad56dbb455cac62d883774f3d8c/users/ace680dd9b6c493fa60aef465623ca5e/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:47:01.054762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993330-9937-4708-b55f-c197f45c1666 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:47:01.055290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993330-9937-4708-b55f-c197f45c1666 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:47:01.055399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993330-9937-4708-b55f-c197f45c1666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:47:01.093471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d6993330-9937-4708-b55f-c197f45c1666 None None] MFA Rules not processed for user `ace680dd9b6c493fa60aef465623ca5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:47:01.095010 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d6993330-9937-4708-b55f-c197f45c1666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:47:01.175336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1218/2451] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:47:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:47:01.192790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97200df2-4876-4b95-8f88-d673a7fad453 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:47:01.246069 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:01.283538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97200df2-4876-4b95-8f88-d673a7fad453 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:47:01.290464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac990c-fcc3-4baa-b2b9-4f611164db59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:47:01.291216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac990c-fcc3-4baa-b2b9-4f611164db59 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:47:01.291506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac990c-fcc3-4baa-b2b9-4f611164db59 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:47:01.291788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac990c-fcc3-4baa-b2b9-4f611164db59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:47:01.396063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac990c-fcc3-4baa-b2b9-4f611164db59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:47:01.398388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac990c-fcc3-4baa-b2b9-4f611164db59 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:47:01.410306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1234/2452] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:47:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:47:04.501008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1124c-d47e-4459-994f-c1ebf2d2c5d8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:47:04.501927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1124c-d47e-4459-994f-c1ebf2d2c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:47:04.502361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1124c-d47e-4459-994f-c1ebf2d2c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:47:04.533014 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-12c1124c-d47e-4459-994f-c1ebf2d2c5d8 None None] MFA Rules not processed for user `01866477c9d04ffc87c126508ecaf0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:47:04.538464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-12c1124c-d47e-4459-994f-c1ebf2d2c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:47:04.565520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1219/2453] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:47:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:47:11.405282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=40 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:14.518354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=78,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:27.152735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac990c-fcc3-4baa-b2b9-4f611164db59 service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:47:27.214710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac990c-fcc3-4baa-b2b9-4f611164db59 service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:47:27.218801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b31f12-4add-4643-875b-a7763d307570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:47:27.219460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b31f12-4add-4643-875b-a7763d307570 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:47:27.219750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b31f12-4add-4643-875b-a7763d307570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:47:27.220031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b31f12-4add-4643-875b-a7763d307570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:47:27.221907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d2b31f12-4add-4643-875b-a7763d307570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:47:27.232179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b31f12-4add-4643-875b-a7763d307570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:47:27.233810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b31f12-4add-4643-875b-a7763d307570 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:47:27.242252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1235/2454] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:47:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:47:37.210388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1124c-d47e-4459-994f-c1ebf2d2c5d8 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:47:37.211900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-12c1124c-d47e-4459-994f-c1ebf2d2c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:47:37.238555 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=26 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:37.285799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1124c-d47e-4459-994f-c1ebf2d2c5d8 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:47:37.292483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd51a0-e940-4941-90c8-f954559d892c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:47:37.293145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd51a0-e940-4941-90c8-f954559d892c service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:47:37.293431 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd51a0-e940-4941-90c8-f954559d892c service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:47:37.293709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd51a0-e940-4941-90c8-f954559d892c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:47:37.296854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-44cd51a0-e940-4941-90c8-f954559d892c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:47:37.309087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd51a0-e940-4941-90c8-f954559d892c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:47:37.310931 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd51a0-e940-4941-90c8-f954559d892c service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:47:37.322079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1220/2455] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:47:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:47:42.567510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede7582-afb0-4863-9d13-7ae7b81242c4 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:47:42.568112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede7582-afb0-4863-9d13-7ae7b81242c4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:47:42.568550 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede7582-afb0-4863-9d13-7ae7b81242c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:47:42.608066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-fede7582-afb0-4863-9d13-7ae7b81242c4 None None] MFA Rules not processed for user `97e53b295eb24d558023b8a120dad771`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:47:42.608066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fede7582-afb0-4863-9d13-7ae7b81242c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:47:42.693005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1236/2456] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:47:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:47:44.025305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd51a0-e940-4941-90c8-f954559d892c service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:47:44.026865 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-44cd51a0-e940-4941-90c8-f954559d892c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:47:44.039493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd51a0-e940-4941-90c8-f954559d892c service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:47:44.043136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bef8f-198b-44a2-9359-fd510be2d1f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:47:44.043804 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bef8f-198b-44a2-9359-fd510be2d1f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:47:44.044114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bef8f-198b-44a2-9359-fd510be2d1f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:47:44.044401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bef8f-198b-44a2-9359-fd510be2d1f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:47:44.054041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bef8f-198b-44a2-9359-fd510be2d1f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:47:44.055505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bef8f-198b-44a2-9359-fd510be2d1f8 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:47:44.065351 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1221/2457] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:47:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:47:52.679921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=25 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:47:53.020254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89d8b-2678-4e78-8950-49282d68d3c6 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:47:53.020552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89d8b-2678-4e78-8950-49282d68d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:47:53.020837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89d8b-2678-4e78-8950-49282d68d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:47:53.038908 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-daa89d8b-2678-4e78-8950-49282d68d3c6 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:47:53.040155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-daa89d8b-2678-4e78-8950-49282d68d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:47:53.105717 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1237/2458] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:47:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:47:53.269030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bef8f-198b-44a2-9359-fd510be2d1f8 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:47:53.271187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-115bef8f-198b-44a2-9359-fd510be2d1f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:47:53.351567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bef8f-198b-44a2-9359-fd510be2d1f8 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:47:53.361707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174cf63-de62-4670-b211-91ea2cb94e48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:47:53.361707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174cf63-de62-4670-b211-91ea2cb94e48 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:47:53.361968 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174cf63-de62-4670-b211-91ea2cb94e48 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:47:53.362115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174cf63-de62-4670-b211-91ea2cb94e48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:47:53.371175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174cf63-de62-4670-b211-91ea2cb94e48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:47:53.372784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174cf63-de62-4670-b211-91ea2cb94e48 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:47:53.381411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1222/2459] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:47:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:48:03.091929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=25 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:03.377791 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=70 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:14.880874 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba45894-938d-4ae0-937d-466de918ab7a None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:48:14.881363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba45894-938d-4ae0-937d-466de918ab7a None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:48:14.881477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba45894-938d-4ae0-937d-466de918ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:48:14.900061 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-0ba45894-938d-4ae0-937d-466de918ab7a None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:48:14.901350 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0ba45894-938d-4ae0-937d-466de918ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:48:14.909569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1238/2460] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:48:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:48:14.921624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174cf63-de62-4670-b211-91ea2cb94e48 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:48:14.933149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174cf63-de62-4670-b211-91ea2cb94e48 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:48:14.939123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a21b8-ea13-469d-8035-9b11b7d26b00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:48:14.939972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a21b8-ea13-469d-8035-9b11b7d26b00 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:48:14.940296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a21b8-ea13-469d-8035-9b11b7d26b00 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:48:14.940578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a21b8-ea13-469d-8035-9b11b7d26b00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:48:14.949961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a21b8-ea13-469d-8035-9b11b7d26b00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:48:14.951853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a21b8-ea13-469d-8035-9b11b7d26b00 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:48:14.963136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1223/2461] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:48:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:48:24.894511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:24.957387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:35.404734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152cd7d-5bc6-4de3-9988-39aefbeeada4 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:48:35.405213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152cd7d-5bc6-4de3-9988-39aefbeeada4 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:48:35.405319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152cd7d-5bc6-4de3-9988-39aefbeeada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:48:35.424689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6152cd7d-5bc6-4de3-9988-39aefbeeada4 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:48:35.425951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6152cd7d-5bc6-4de3-9988-39aefbeeada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:48:35.433427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1239/2462] 10.222.0.77 () {58 vars in 967 bytes} [Thu Jun 16 17:48:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:48:35.446667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a21b8-ea13-469d-8035-9b11b7d26b00 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:48:35.458919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a21b8-ea13-469d-8035-9b11b7d26b00 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:48:35.464004 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b313f-a21e-4291-8263-2dca3e7ad1ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:48:35.464684 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b313f-a21e-4291-8263-2dca3e7ad1ca service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:48:35.464963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b313f-a21e-4291-8263-2dca3e7ad1ca service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:48:35.465235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b313f-a21e-4291-8263-2dca3e7ad1ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:48:35.474128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b313f-a21e-4291-8263-2dca3e7ad1ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:48:35.475702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b313f-a21e-4291-8263-2dca3e7ad1ca service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:48:35.484482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1224/2463] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:48:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:48:45.418780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:48:45.480948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:32.207696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152cd7d-5bc6-4de3-9988-39aefbeeada4 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:32.213863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6152cd7d-5bc6-4de3-9988-39aefbeeada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:32.272617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152cd7d-5bc6-4de3-9988-39aefbeeada4 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:32.276677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed655ff6-0f04-4a42-9b90-219d805cf2b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:32.277344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655ff6-0f04-4a42-9b90-219d805cf2b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:32.277626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655ff6-0f04-4a42-9b90-219d805cf2b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:32.277901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655ff6-0f04-4a42-9b90-219d805cf2b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:32.279696 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ed655ff6-0f04-4a42-9b90-219d805cf2b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:32.295173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed655ff6-0f04-4a42-9b90-219d805cf2b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:32.297280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed655ff6-0f04-4a42-9b90-219d805cf2b4 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:32.310958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1240/2464] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:49:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:49:36.575554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b313f-a21e-4291-8263-2dca3e7ad1ca service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:36.577022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b77b313f-a21e-4291-8263-2dca3e7ad1ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:36.590548 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b313f-a21e-4291-8263-2dca3e7ad1ca service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:36.594807 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88997119-c7a2-45fc-8d91-c0129aef23f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:36.595454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88997119-c7a2-45fc-8d91-c0129aef23f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:36.595735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88997119-c7a2-45fc-8d91-c0129aef23f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:36.596008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88997119-c7a2-45fc-8d91-c0129aef23f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:36.597815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-88997119-c7a2-45fc-8d91-c0129aef23f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:36.617092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88997119-c7a2-45fc-8d91-c0129aef23f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:36.618654 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88997119-c7a2-45fc-8d91-c0129aef23f8 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:36.630350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1225/2465] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:49:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:49:42.303780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=26 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:46.625174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:50.703182 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed655ff6-0f04-4a42-9b90-219d805cf2b4 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:50.712649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed655ff6-0f04-4a42-9b90-219d805cf2b4 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:50.716317 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf3bae-6ec2-4e52-bc0e-d2e50900f893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:50.717006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf3bae-6ec2-4e52-bc0e-d2e50900f893 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:50.717438 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf3bae-6ec2-4e52-bc0e-d2e50900f893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:50.718276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf3bae-6ec2-4e52-bc0e-d2e50900f893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:50.720160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-daaf3bae-6ec2-4e52-bc0e-d2e50900f893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:50.785892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf3bae-6ec2-4e52-bc0e-d2e50900f893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:50.787437 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf3bae-6ec2-4e52-bc0e-d2e50900f893 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:50.799494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1241/2466] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:49:54.279006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88997119-c7a2-45fc-8d91-c0129aef23f8 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:54.296521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88997119-c7a2-45fc-8d91-c0129aef23f8 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:54.296917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f133d09-d3c7-4d96-885e-9b37dfc3e39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:54.297620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f133d09-d3c7-4d96-885e-9b37dfc3e39c service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:54.297908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f133d09-d3c7-4d96-885e-9b37dfc3e39c service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:54.298187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f133d09-d3c7-4d96-885e-9b37dfc3e39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:54.300845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5f133d09-d3c7-4d96-885e-9b37dfc3e39c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:54.315799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f133d09-d3c7-4d96-885e-9b37dfc3e39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:54.317298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f133d09-d3c7-4d96-885e-9b37dfc3e39c service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:54.328714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1226/2467] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:49:54.556187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf3bae-6ec2-4e52-bc0e-d2e50900f893 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:54.557678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-daaf3bae-6ec2-4e52-bc0e-d2e50900f893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:54.571811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf3bae-6ec2-4e52-bc0e-d2e50900f893 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:54.578394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:54.585704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:54.585704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:54.585704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] PATH_INFO: `/v3/users/97e53b295eb24d558023b8a120dad771` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:54.602919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e53b295eb24d558023b8a120dad771)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:54.605282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:54.866659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e53b295eb24d558023b8a120dad771'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:54.882082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e53b295eb24d558023b8a120dad771'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:54.988509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e53b295eb24d558023b8a120dad771'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:54.989404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e53b295eb24d558023b8a120dad771'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:54.990106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a91aca5-ebd3-4ad8-9193-c8595ff80268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e53b295eb24d558023b8a120dad771'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:55.004803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1242/2468] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:49:54 2022] DELETE /identity/v3/users/97e53b295eb24d558023b8a120dad771 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:49:55.317757 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f133d09-d3c7-4d96-885e-9b37dfc3e39c service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:55.326993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f133d09-d3c7-4d96-885e-9b37dfc3e39c service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:55.393983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:55.394871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:55.395157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:55.395439 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] PATH_INFO: `/v3/projects/6c57d2f6443544a3b1848c7122deda68` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:55.407733 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c57d2f6443544a3b1848c7122deda68)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:55.409691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:55.576948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c57d2f6443544a3b1848c7122deda68', 'request_id': 'req-e08377fa-6a1c-4fa9-b91b-a301d2570b76'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:55.586009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c57d2f6443544a3b1848c7122deda68', 'request_id': 'req-e08377fa-6a1c-4fa9-b91b-a301d2570b76'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:55.697100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c57d2f6443544a3b1848c7122deda68', 'request_id': 'req-e08377fa-6a1c-4fa9-b91b-a301d2570b76'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:55.712244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] The token cache is being invalidate because project 6c57d2f6443544a3b1848c7122deda68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:49:55.712703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:55.713737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e08377fa-6a1c-4fa9-b91b-a301d2570b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:55.716445 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1227/2469] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:49:55 2022] DELETE /identity/v3/projects/6c57d2f6443544a3b1848c7122deda68 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:49:55.722009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3ac3-2630-4ced-8b34-c562f5ebccb5 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:55.722590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3ac3-2630-4ced-8b34-c562f5ebccb5 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:55.722590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3ac3-2630-4ced-8b34-c562f5ebccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:55.744355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3d2d3ac3-2630-4ced-8b34-c562f5ebccb5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:49:55.745622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3d2d3ac3-2630-4ced-8b34-c562f5ebccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:55.805627 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:55.831698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1243/2470] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:49:55.833423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e7224-747b-4a67-9820-1f5f04cc4798 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:55.833712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e7224-747b-4a67-9820-1f5f04cc4798 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:55.833995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e7224-747b-4a67-9820-1f5f04cc4798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:55.854557 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3a5e7224-747b-4a67-9820-1f5f04cc4798 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:49:55.858461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3a5e7224-747b-4a67-9820-1f5f04cc4798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:55.866270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1228/2471] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:49:55.870715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d3ac3-2630-4ced-8b34-c562f5ebccb5 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:55.881617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d3ac3-2630-4ced-8b34-c562f5ebccb5 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:55.887178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28c162-1dad-4865-8ed5-b0bc987b9ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:55.888299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28c162-1dad-4865-8ed5-b0bc987b9ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:55.888299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28c162-1dad-4865-8ed5-b0bc987b9ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:55.888523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28c162-1dad-4865-8ed5-b0bc987b9ba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:55.889938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28c162-1dad-4865-8ed5-b0bc987b9ba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:49:55.890288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28c162-1dad-4865-8ed5-b0bc987b9ba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:55.892054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28c162-1dad-4865-8ed5-b0bc987b9ba6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:55.905754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1244/2472] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:49:55.910631 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e7224-747b-4a67-9820-1f5f04cc4798 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:55.920587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e7224-747b-4a67-9820-1f5f04cc4798 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:55.925694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f2c85-e0a4-4596-9a3e-878dad40a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:55.926368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f2c85-e0a4-4596-9a3e-878dad40a224 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:55.926647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f2c85-e0a4-4596-9a3e-878dad40a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:55.926919 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f2c85-e0a4-4596-9a3e-878dad40a224 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:55.927608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f2c85-e0a4-4596-9a3e-878dad40a224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:55.929556 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f2c85-e0a4-4596-9a3e-878dad40a224 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:56.030764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1229/2473] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:49:55 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:49:56.034990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28c162-1dad-4865-8ed5-b0bc987b9ba6 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:56.047606 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28c162-1dad-4865-8ed5-b0bc987b9ba6 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:56.121993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f733e5c-7495-4ba9-9b59-d16700eaa930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:56.122787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733e5c-7495-4ba9-9b59-d16700eaa930 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:56.123144 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733e5c-7495-4ba9-9b59-d16700eaa930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:56.123525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733e5c-7495-4ba9-9b59-d16700eaa930 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:56.124343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f733e5c-7495-4ba9-9b59-d16700eaa930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:56.126517 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f733e5c-7495-4ba9-9b59-d16700eaa930 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:56.293658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1245/2474] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:49:56 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:49:56.298541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f2c85-e0a4-4596-9a3e-878dad40a224 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:56.311722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f2c85-e0a4-4596-9a3e-878dad40a224 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:56.322691 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f37b5-7993-41bd-9dd0-3ad4624f5688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:56.324345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f37b5-7993-41bd-9dd0-3ad4624f5688 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:56.324661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f37b5-7993-41bd-9dd0-3ad4624f5688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:56.325089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f37b5-7993-41bd-9dd0-3ad4624f5688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:56.325812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f37b5-7993-41bd-9dd0-3ad4624f5688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:56.328105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f37b5-7993-41bd-9dd0-3ad4624f5688 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:56.344198 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1230/2475] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:49:56.345142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f733e5c-7495-4ba9-9b59-d16700eaa930 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:56.356505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f733e5c-7495-4ba9-9b59-d16700eaa930 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:56.365658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f4b44-abfc-4f69-831e-828908a31db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:56.366061 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f4b44-abfc-4f69-831e-828908a31db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:56.366354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f4b44-abfc-4f69-831e-828908a31db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:56.366632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f4b44-abfc-4f69-831e-828908a31db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:56.367384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f4b44-abfc-4f69-831e-828908a31db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:56.370229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f4b44-abfc-4f69-831e-828908a31db3 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:56.384602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1246/2476] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:49:56.389535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f37b5-7993-41bd-9dd0-3ad4624f5688 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:56.400167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f37b5-7993-41bd-9dd0-3ad4624f5688 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:56.407592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0f813-4c03-4d90-8954-52f224fac596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:56.408545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0f813-4c03-4d90-8954-52f224fac596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:56.408829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0f813-4c03-4d90-8954-52f224fac596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:56.409103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0f813-4c03-4d90-8954-52f224fac596 admin admin] PATH_INFO: `/v3/projects/3241fb01d0244ea0b059aaf35f5ae220/users/cc5f4a067f874ee88ed3f648cc98b85e/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:56.429063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0f813-4c03-4d90-8954-52f224fac596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3241fb01d0244ea0b059aaf35f5ae220, user_id=cc5f4a067f874ee88ed3f648cc98b85e, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:56.432802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0f813-4c03-4d90-8954-52f224fac596 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:56.512181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1231/2477] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:49:56 2022] PUT /identity/v3/projects/3241fb01d0244ea0b059aaf35f5ae220/users/cc5f4a067f874ee88ed3f648cc98b85e/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:49:56.519564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970932-786a-4290-8ad5-5380729605aa None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:56.519860 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970932-786a-4290-8ad5-5380729605aa None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:56.520176 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970932-786a-4290-8ad5-5380729605aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:56.554612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-41970932-786a-4290-8ad5-5380729605aa None None] MFA Rules not processed for user `cc5f4a067f874ee88ed3f648cc98b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:49:56.555998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-41970932-786a-4290-8ad5-5380729605aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:56.635665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1247/2478] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:49:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:49:56.640224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0f813-4c03-4d90-8954-52f224fac596 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:56.646939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:56.721940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0f813-4c03-4d90-8954-52f224fac596 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:56.727214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd4609-7bc7-4ff7-9d3e-23314b7d8f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:56.727972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd4609-7bc7-4ff7-9d3e-23314b7d8f16 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:56.728320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd4609-7bc7-4ff7-9d3e-23314b7d8f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:56.728593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd4609-7bc7-4ff7-9d3e-23314b7d8f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:56.729242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd4609-7bc7-4ff7-9d3e-23314b7d8f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:56.731161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd4609-7bc7-4ff7-9d3e-23314b7d8f16 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:56.910673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1232/2479] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:49:56 2022] POST /identity/v3/projects => generated 361 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:49:56.915081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41970932-786a-4290-8ad5-5380729605aa None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:56.930532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41970932-786a-4290-8ad5-5380729605aa None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:56.990123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:57.001495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e7793-1451-4c37-ac21-ce875bdc1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:57.002356 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e7793-1451-4c37-ac21-ce875bdc1acc admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:57.002645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e7793-1451-4c37-ac21-ce875bdc1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:57.002923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e7793-1451-4c37-ac21-ce875bdc1acc admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:57.003652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e7793-1451-4c37-ac21-ce875bdc1acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:57.005634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e7793-1451-4c37-ac21-ce875bdc1acc admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:57.118944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1248/2480] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:49:56 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:49:57.123048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd4609-7bc7-4ff7-9d3e-23314b7d8f16 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:57.134680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd4609-7bc7-4ff7-9d3e-23314b7d8f16 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:57.140292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598ed35-31f7-49bb-9999-126396e7dfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:57.140969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598ed35-31f7-49bb-9999-126396e7dfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:57.141249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598ed35-31f7-49bb-9999-126396e7dfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:57.141579 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598ed35-31f7-49bb-9999-126396e7dfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:57.142419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598ed35-31f7-49bb-9999-126396e7dfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:57.144033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598ed35-31f7-49bb-9999-126396e7dfb8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:57.155932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1233/2481] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:49:57.160198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e7793-1451-4c37-ac21-ce875bdc1acc admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:57.174412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e7793-1451-4c37-ac21-ce875bdc1acc admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:57.175531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcf466-d396-4f33-b6eb-b6c07397cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:57.176484 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcf466-d396-4f33-b6eb-b6c07397cff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:57.176769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcf466-d396-4f33-b6eb-b6c07397cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:57.177044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcf466-d396-4f33-b6eb-b6c07397cff5 admin admin] PATH_INFO: `/v3/projects/f324ac4b87bc4b8e93bc042ad0a00202/users/c13165b7228d4fee87fd2728a7d0f92a/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:57.197149 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcf466-d396-4f33-b6eb-b6c07397cff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f324ac4b87bc4b8e93bc042ad0a00202, user_id=c13165b7228d4fee87fd2728a7d0f92a, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:57.200506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcf466-d396-4f33-b6eb-b6c07397cff5 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:57.286332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1249/2482] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:49:57 2022] PUT /identity/v3/projects/f324ac4b87bc4b8e93bc042ad0a00202/users/c13165b7228d4fee87fd2728a7d0f92a/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:49:57.291037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598ed35-31f7-49bb-9999-126396e7dfb8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:57.303028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598ed35-31f7-49bb-9999-126396e7dfb8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:57.366418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dfb1c-4bbf-4728-934a-3690ea058853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:57.367048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dfb1c-4bbf-4728-934a-3690ea058853 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:57.367287 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dfb1c-4bbf-4728-934a-3690ea058853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:57.367563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dfb1c-4bbf-4728-934a-3690ea058853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:57.368320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dfb1c-4bbf-4728-934a-3690ea058853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:57.370071 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dfb1c-4bbf-4728-934a-3690ea058853 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:57.386154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1234/2483] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:49:57.386951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcf466-d396-4f33-b6eb-b6c07397cff5 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:57.401535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcf466-d396-4f33-b6eb-b6c07397cff5 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:57.407963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef864bc7-c300-425e-aea8-bef9b7d48380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:57.408938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864bc7-c300-425e-aea8-bef9b7d48380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:57.409226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864bc7-c300-425e-aea8-bef9b7d48380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:57.412211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864bc7-c300-425e-aea8-bef9b7d48380 admin admin] PATH_INFO: `/v3/projects/f324ac4b87bc4b8e93bc042ad0a00202/users/c13165b7228d4fee87fd2728a7d0f92a/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:57.412211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef864bc7-c300-425e-aea8-bef9b7d48380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f324ac4b87bc4b8e93bc042ad0a00202, user_id=c13165b7228d4fee87fd2728a7d0f92a, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:57.415005 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef864bc7-c300-425e-aea8-bef9b7d48380 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:57.429100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1250/2484] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:49:57 2022] PUT /identity/v3/projects/f324ac4b87bc4b8e93bc042ad0a00202/users/c13165b7228d4fee87fd2728a7d0f92a/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:49:57.442268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612197e-9169-4609-a8e7-5a1048ac8209 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:57.442592 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612197e-9169-4609-a8e7-5a1048ac8209 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:57.442882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612197e-9169-4609-a8e7-5a1048ac8209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:57.476746 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-4612197e-9169-4609-a8e7-5a1048ac8209 None None] MFA Rules not processed for user `c13165b7228d4fee87fd2728a7d0f92a`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:49:57.478290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4612197e-9169-4609-a8e7-5a1048ac8209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:57.568710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:57.573839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1235/2485] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:49:57 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:49:57.586844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef864bc7-c300-425e-aea8-bef9b7d48380 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:57.588646 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ef864bc7-c300-425e-aea8-bef9b7d48380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:57.659296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef864bc7-c300-425e-aea8-bef9b7d48380 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:57.663701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de93835-1fcb-4880-be50-c320b6888d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:57.665523 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de93835-1fcb-4880-be50-c320b6888d6d service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:57.665839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de93835-1fcb-4880-be50-c320b6888d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:57.669650 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de93835-1fcb-4880-be50-c320b6888d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:57.679067 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de93835-1fcb-4880-be50-c320b6888d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:57.680591 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de93835-1fcb-4880-be50-c320b6888d6d service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:57.692461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1251/2486] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:49:57 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:49:58.736347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612197e-9169-4609-a8e7-5a1048ac8209 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:58.738020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4612197e-9169-4609-a8e7-5a1048ac8209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:58.816183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612197e-9169-4609-a8e7-5a1048ac8209 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:58.820920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:58.821809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:58.822085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:58.822358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] PATH_INFO: `/v3/users/65a3da0b77fd473584f7e356c05890a8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:58.836833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a3da0b77fd473584f7e356c05890a8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:58.838772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:58.896910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de93835-1fcb-4880-be50-c320b6888d6d service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:58.909200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de93835-1fcb-4880-be50-c320b6888d6d service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:58.914093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93474390-080c-410a-af92-746142a77123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:58.915097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474390-080c-410a-af92-746142a77123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:58.915354 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474390-080c-410a-af92-746142a77123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:58.915648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474390-080c-410a-af92-746142a77123 admin admin] PATH_INFO: `/v3/users/cc5f4a067f874ee88ed3f648cc98b85e` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:58.917316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93474390-080c-410a-af92-746142a77123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5f4a067f874ee88ed3f648cc98b85e)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:58.919303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93474390-080c-410a-af92-746142a77123 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:59.117371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a3da0b77fd473584f7e356c05890a8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.129564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a3da0b77fd473584f7e356c05890a8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.182463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-93474390-080c-410a-af92-746142a77123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5f4a067f874ee88ed3f648cc98b85e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.194402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-93474390-080c-410a-af92-746142a77123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5f4a067f874ee88ed3f648cc98b85e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.294476 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a3da0b77fd473584f7e356c05890a8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.295119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a3da0b77fd473584f7e356c05890a8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.295747 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-53ab293d-26d9-45ca-aba7-6c9f0dcfe04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a3da0b77fd473584f7e356c05890a8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.311400 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1236/2487] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:49:58 2022] DELETE /identity/v3/users/65a3da0b77fd473584f7e356c05890a8 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:49:59.363021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-93474390-080c-410a-af92-746142a77123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5f4a067f874ee88ed3f648cc98b85e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.363661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-93474390-080c-410a-af92-746142a77123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5f4a067f874ee88ed3f648cc98b85e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.364316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-93474390-080c-410a-af92-746142a77123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5f4a067f874ee88ed3f648cc98b85e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.380713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1252/2488] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:49:58 2022] DELETE /identity/v3/users/cc5f4a067f874ee88ed3f648cc98b85e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:49:59.385482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cccb8c-2b31-4a76-ab07-05a3768e6ca7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:59.385775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cccb8c-2b31-4a76-ab07-05a3768e6ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:59.386056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cccb8c-2b31-4a76-ab07-05a3768e6ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:59.406725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c1cccb8c-2b31-4a76-ab07-05a3768e6ca7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:49:59.411852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c1cccb8c-2b31-4a76-ab07-05a3768e6ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:59.474380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1237/2489] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:49:59.485224 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93474390-080c-410a-af92-746142a77123 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:59.486854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-93474390-080c-410a-af92-746142a77123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:59.510726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:59.553116 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93474390-080c-410a-af92-746142a77123 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:59.556883 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d832f-b94c-4a1c-b862-68ad694159dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:59.557609 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d832f-b94c-4a1c-b862-68ad694159dc service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:59.557897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d832f-b94c-4a1c-b862-68ad694159dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:59.558173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d832f-b94c-4a1c-b862-68ad694159dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:59.569707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d832f-b94c-4a1c-b862-68ad694159dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:59.571635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d832f-b94c-4a1c-b862-68ad694159dc service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:59.583655 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1253/2490] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:49:59.613449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cccb8c-2b31-4a76-ab07-05a3768e6ca7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:49:59.619748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c1cccb8c-2b31-4a76-ab07-05a3768e6ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:49:59.628261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cccb8c-2b31-4a76-ab07-05a3768e6ca7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:49:59.633975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:49:59.634797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:59.635087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:59.635368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] PATH_INFO: `/v3/projects/9b63e76bf15543259db617fe9d2c5cf2` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:59.640572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:49:59.652315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b63e76bf15543259db617fe9d2c5cf2)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:49:59.654255 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:49:59.802790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b63e76bf15543259db617fe9d2c5cf2', 'request_id': 'req-34862aa1-6587-4150-bd39-31c901cb9ae7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.808116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b63e76bf15543259db617fe9d2c5cf2', 'request_id': 'req-34862aa1-6587-4150-bd39-31c901cb9ae7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.903829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b63e76bf15543259db617fe9d2c5cf2', 'request_id': 'req-34862aa1-6587-4150-bd39-31c901cb9ae7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.919475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] The token cache is being invalidate because project 9b63e76bf15543259db617fe9d2c5cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:49:59.919475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.919475 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-34862aa1-6587-4150-bd39-31c901cb9ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:49:59.922127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1238/2491] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:49:59 2022] DELETE /identity/v3/projects/9b63e76bf15543259db617fe9d2c5cf2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:49:59.927458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed36dc-bdc7-4027-81d8-467044aba33f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:49:59.927980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed36dc-bdc7-4027-81d8-467044aba33f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:49:59.928254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed36dc-bdc7-4027-81d8-467044aba33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:49:59.957818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-01ed36dc-bdc7-4027-81d8-467044aba33f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:49:59.960822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-01ed36dc-bdc7-4027-81d8-467044aba33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:00.022927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1254/2492] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:00.031776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560a050-b315-4c2b-8ff0-8fad33130e5c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.032100 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560a050-b315-4c2b-8ff0-8fad33130e5c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.032390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560a050-b315-4c2b-8ff0-8fad33130e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.056209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed36dc-bdc7-4027-81d8-467044aba33f None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:00.059097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-01ed36dc-bdc7-4027-81d8-467044aba33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:00.061688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c560a050-b315-4c2b-8ff0-8fad33130e5c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:00.063227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c560a050-b315-4c2b-8ff0-8fad33130e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:00.074487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed36dc-bdc7-4027-81d8-467044aba33f None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:00.078218 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1239/2493] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:00.079526 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560a050-b315-4c2b-8ff0-8fad33130e5c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:00.087537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:00.087537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.087537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.087537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] PATH_INFO: `/v3/projects/3241fb01d0244ea0b059aaf35f5ae220` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.088011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3241fb01d0244ea0b059aaf35f5ae220)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:00.088011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:00.089763 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560a050-b315-4c2b-8ff0-8fad33130e5c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:00.096809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0c233-4061-4a85-accd-5ac0b8aba9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:00.097609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0c233-4061-4a85-accd-5ac0b8aba9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.098009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0c233-4061-4a85-accd-5ac0b8aba9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.098480 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0c233-4061-4a85-accd-5ac0b8aba9a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.099341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0c233-4061-4a85-accd-5ac0b8aba9a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:00.099760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0c233-4061-4a85-accd-5ac0b8aba9a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:00.101510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0c233-4061-4a85-accd-5ac0b8aba9a2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:00.116062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1240/2494] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:50:00.121493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0c233-4061-4a85-accd-5ac0b8aba9a2 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:00.131474 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0c233-4061-4a85-accd-5ac0b8aba9a2 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:00.136341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a82449-f838-47b1-a59f-bc6575e37d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:00.137063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a82449-f838-47b1-a59f-bc6575e37d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.137292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a82449-f838-47b1-a59f-bc6575e37d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.137569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a82449-f838-47b1-a59f-bc6575e37d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.138253 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a82449-f838-47b1-a59f-bc6575e37d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:00.140814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a82449-f838-47b1-a59f-bc6575e37d5c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:00.223774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3241fb01d0244ea0b059aaf35f5ae220', 'request_id': 'req-34a73acd-0005-4af3-af19-46852e023c36'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:00.229503 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3241fb01d0244ea0b059aaf35f5ae220', 'request_id': 'req-34a73acd-0005-4af3-af19-46852e023c36'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:00.230750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1241/2495] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:00 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:00.235993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a82449-f838-47b1-a59f-bc6575e37d5c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:00.236963 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3241fb01d0244ea0b059aaf35f5ae220', 'request_id': 'req-34a73acd-0005-4af3-af19-46852e023c36'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:00.299565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a82449-f838-47b1-a59f-bc6575e37d5c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:00.304860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3383a3-ef09-4895-b1f2-0ceecb122dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:00.305707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3383a3-ef09-4895-b1f2-0ceecb122dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.306037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3383a3-ef09-4895-b1f2-0ceecb122dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.306424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3383a3-ef09-4895-b1f2-0ceecb122dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.307263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3383a3-ef09-4895-b1f2-0ceecb122dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:00.309422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3383a3-ef09-4895-b1f2-0ceecb122dc4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:00.342436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] The token cache is being invalidate because project 3241fb01d0244ea0b059aaf35f5ae220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:00.343289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:00.343995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:00.345737 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1255/2496] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:00 2022] DELETE /identity/v3/projects/3241fb01d0244ea0b059aaf35f5ae220 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:00.349758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:00.351245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:00.422204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a73acd-0005-4af3-af19-46852e023c36 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:00.427521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:00.428455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.428734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.429007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] PATH_INFO: `/v3/users/c13165b7228d4fee87fd2728a7d0f92a` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.430234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13165b7228d4fee87fd2728a7d0f92a)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:00.432252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:00.438539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1242/2497] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:00 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:00.439944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3383a3-ef09-4895-b1f2-0ceecb122dc4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:00.442049 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9e3383a3-ef09-4895-b1f2-0ceecb122dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:00.455854 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3383a3-ef09-4895-b1f2-0ceecb122dc4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:00.460862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44c77-c3d0-4fe7-bb5c-5bbbc9e78938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:00.461537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44c77-c3d0-4fe7-bb5c-5bbbc9e78938 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.461823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44c77-c3d0-4fe7-bb5c-5bbbc9e78938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.462272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44c77-c3d0-4fe7-bb5c-5bbbc9e78938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.463009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44c77-c3d0-4fe7-bb5c-5bbbc9e78938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:00.464653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44c77-c3d0-4fe7-bb5c-5bbbc9e78938 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:00.476995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1243/2498] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:00.481174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44c77-c3d0-4fe7-bb5c-5bbbc9e78938 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:00.485574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:00.491986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44c77-c3d0-4fe7-bb5c-5bbbc9e78938 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:00.497026 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f0a0-b7f1-45db-bbc2-f4b1eae9124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:00.497700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f0a0-b7f1-45db-bbc2-f4b1eae9124e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.498038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f0a0-b7f1-45db-bbc2-f4b1eae9124e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.498325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f0a0-b7f1-45db-bbc2-f4b1eae9124e admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.499054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7f0a0-b7f1-45db-bbc2-f4b1eae9124e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:00.500784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7f0a0-b7f1-45db-bbc2-f4b1eae9124e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:00.511896 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1244/2499] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:00.516715 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f0a0-b7f1-45db-bbc2-f4b1eae9124e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:00.527630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f0a0-b7f1-45db-bbc2-f4b1eae9124e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:00.533922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903b8d9-e8fb-49f2-84ec-0821e181a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:00.534875 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903b8d9-e8fb-49f2-84ec-0821e181a458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.535157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903b8d9-e8fb-49f2-84ec-0821e181a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.535433 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903b8d9-e8fb-49f2-84ec-0821e181a458 admin admin] PATH_INFO: `/v3/projects/0b682622cdb543c68a2245ff223f10e6/users/18d26c9e6f6d4a809ae55f8dee3b8632/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.554756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903b8d9-e8fb-49f2-84ec-0821e181a458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b682622cdb543c68a2245ff223f10e6, user_id=18d26c9e6f6d4a809ae55f8dee3b8632, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:00.557550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903b8d9-e8fb-49f2-84ec-0821e181a458 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:00.611312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13165b7228d4fee87fd2728a7d0f92a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:00.623702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13165b7228d4fee87fd2728a7d0f92a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:00.633741 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:00.640964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1245/2500] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:00 2022] PUT /identity/v3/projects/0b682622cdb543c68a2245ff223f10e6/users/18d26c9e6f6d4a809ae55f8dee3b8632/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:00.651539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13696e-a8d9-4020-b66e-3cebc9715256 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.651825 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13696e-a8d9-4020-b66e-3cebc9715256 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.652135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13696e-a8d9-4020-b66e-3cebc9715256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.679857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9d13696e-a8d9-4020-b66e-3cebc9715256 None None] MFA Rules not processed for user `18d26c9e6f6d4a809ae55f8dee3b8632`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:00.681108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9d13696e-a8d9-4020-b66e-3cebc9715256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:00.707775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13165b7228d4fee87fd2728a7d0f92a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:00.708663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13165b7228d4fee87fd2728a7d0f92a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:00.709353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13165b7228d4fee87fd2728a7d0f92a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:00.725253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1256/2501] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:00 2022] DELETE /identity/v3/users/c13165b7228d4fee87fd2728a7d0f92a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:00.756170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1246/2502] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:00.772747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:00.774192 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:00.867928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092fc06-2c44-49c2-8037-61f13e27c4e5 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:00.874328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f781c-501b-4e3d-bfa9-1f11d0d64f04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:00.874989 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f781c-501b-4e3d-bfa9-1f11d0d64f04 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:00.875278 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f781c-501b-4e3d-bfa9-1f11d0d64f04 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:00.875554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f781c-501b-4e3d-bfa9-1f11d0d64f04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:00.937680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f781c-501b-4e3d-bfa9-1f11d0d64f04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:00.939312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f781c-501b-4e3d-bfa9-1f11d0d64f04 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:00.950311 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1257/2503] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:01.191637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13696e-a8d9-4020-b66e-3cebc9715256 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:01.193430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9d13696e-a8d9-4020-b66e-3cebc9715256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:01.218567 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f781c-501b-4e3d-bfa9-1f11d0d64f04 service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:01.220228 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ed7f781c-501b-4e3d-bfa9-1f11d0d64f04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:01.273030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13696e-a8d9-4020-b66e-3cebc9715256 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:01.303057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f781c-501b-4e3d-bfa9-1f11d0d64f04 service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:01.309141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:01.310055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:01.310533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:01.311380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] PATH_INFO: `/v3/projects/f324ac4b87bc4b8e93bc042ad0a00202` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:01.314219 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f324ac4b87bc4b8e93bc042ad0a00202)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:01.316164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:01.340665 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:01.346194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:01.346194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:01.346194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] PATH_INFO: `/v3/users/18d26c9e6f6d4a809ae55f8dee3b8632` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:01.346194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d26c9e6f6d4a809ae55f8dee3b8632)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:01.346194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:01.446736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f324ac4b87bc4b8e93bc042ad0a00202', 'request_id': 'req-d5742d28-0a35-42d4-90d6-27e8142ce289'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:01.452023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f324ac4b87bc4b8e93bc042ad0a00202', 'request_id': 'req-d5742d28-0a35-42d4-90d6-27e8142ce289'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:01.458203 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f324ac4b87bc4b8e93bc042ad0a00202', 'request_id': 'req-d5742d28-0a35-42d4-90d6-27e8142ce289'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:01.538590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] The token cache is being invalidate because project f324ac4b87bc4b8e93bc042ad0a00202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:01.539050 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:01.539794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d5742d28-0a35-42d4-90d6-27e8142ce289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:01.541814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1258/2504] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:01 2022] DELETE /identity/v3/projects/f324ac4b87bc4b8e93bc042ad0a00202 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:01.548472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b066-6390-4253-9cdc-a6bd488793d9 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:01.548847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b066-6390-4253-9cdc-a6bd488793d9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:01.549171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d26c9e6f6d4a809ae55f8dee3b8632'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:01.549347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b066-6390-4253-9cdc-a6bd488793d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:01.566615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d26c9e6f6d4a809ae55f8dee3b8632'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:01.569474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9349b066-6390-4253-9cdc-a6bd488793d9 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:01.570688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9349b066-6390-4253-9cdc-a6bd488793d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:01.619401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:01.638934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1259/2505] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:01.645040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d26c9e6f6d4a809ae55f8dee3b8632'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:01.645696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d26c9e6f6d4a809ae55f8dee3b8632'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:01.646455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cdc3b96-24a0-4a1c-bc57-3a29b8426357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d26c9e6f6d4a809ae55f8dee3b8632'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:01.646752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be075-7816-49be-9025-aecc4d5f6d55 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:01.647131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be075-7816-49be-9025-aecc4d5f6d55 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:01.647362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be075-7816-49be-9025-aecc4d5f6d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:01.662091 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1247/2506] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:01 2022] DELETE /identity/v3/users/18d26c9e6f6d4a809ae55f8dee3b8632 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:01.666535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823a62-63f1-4818-b5ee-df0297ed4a3a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:01.666825 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823a62-63f1-4818-b5ee-df0297ed4a3a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:01.667105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823a62-63f1-4818-b5ee-df0297ed4a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:01.668957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-264be075-7816-49be-9025-aecc4d5f6d55 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:01.671024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-264be075-7816-49be-9025-aecc4d5f6d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:01.677640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:01.687288 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7a823a62-63f1-4818-b5ee-df0297ed4a3a None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:01.688546 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7a823a62-63f1-4818-b5ee-df0297ed4a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:01.744375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1260/2507] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:01.745504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be075-7816-49be-9025-aecc4d5f6d55 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:01.754614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1248/2508] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:01.757458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be075-7816-49be-9025-aecc4d5f6d55 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:01.761554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377098-b47c-416a-bc4a-2c267ccbc896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:01.762334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377098-b47c-416a-bc4a-2c267ccbc896 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:01.762620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377098-b47c-416a-bc4a-2c267ccbc896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:01.762902 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377098-b47c-416a-bc4a-2c267ccbc896 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:01.763782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea377098-b47c-416a-bc4a-2c267ccbc896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:01.764468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea377098-b47c-416a-bc4a-2c267ccbc896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:01.764967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823a62-63f1-4818-b5ee-df0297ed4a3a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:01.769131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea377098-b47c-416a-bc4a-2c267ccbc896 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:01.769281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7a823a62-63f1-4818-b5ee-df0297ed4a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:01.778849 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1261/2509] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:50:01.785769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377098-b47c-416a-bc4a-2c267ccbc896 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:01.797547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377098-b47c-416a-bc4a-2c267ccbc896 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:01.802876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9dec2-9806-4ec0-8b1b-576f4cf1e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:01.808852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9dec2-9806-4ec0-8b1b-576f4cf1e9ba admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:01.808852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9dec2-9806-4ec0-8b1b-576f4cf1e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:01.808852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9dec2-9806-4ec0-8b1b-576f4cf1e9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:01.808852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9dec2-9806-4ec0-8b1b-576f4cf1e9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:01.808852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9dec2-9806-4ec0-8b1b-576f4cf1e9ba admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:01.832568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823a62-63f1-4818-b5ee-df0297ed4a3a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:01.836251 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80adc09-9024-4a23-b910-78e5a250c4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:01.836904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80adc09-9024-4a23-b910-78e5a250c4ce service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:01.837190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80adc09-9024-4a23-b910-78e5a250c4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:01.837495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80adc09-9024-4a23-b910-78e5a250c4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:01.848613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80adc09-9024-4a23-b910-78e5a250c4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:01.850106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80adc09-9024-4a23-b910-78e5a250c4ce service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:01.860856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1249/2510] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:01.908355 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1262/2511] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:01 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:01.913035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80adc09-9024-4a23-b910-78e5a250c4ce service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:01.922745 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80adc09-9024-4a23-b910-78e5a250c4ce service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:01.923565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:01.993464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3e56d-3d7f-4a83-a375-d85ee73877bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:01.994149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3e56d-3d7f-4a83-a375-d85ee73877bc admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:01.994492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3e56d-3d7f-4a83-a375-d85ee73877bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:01.994712 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3e56d-3d7f-4a83-a375-d85ee73877bc admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:01.995409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3e56d-3d7f-4a83-a375-d85ee73877bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:01.997409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3e56d-3d7f-4a83-a375-d85ee73877bc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:02.039151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:02.114732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1250/2512] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:01 2022] POST /identity/v3/users => generated 283 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:02.118855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9dec2-9806-4ec0-8b1b-576f4cf1e9ba admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:02.131910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9dec2-9806-4ec0-8b1b-576f4cf1e9ba admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:02.137358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d102f6-2e01-4727-be77-8f179bdd564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:02.138295 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d102f6-2e01-4727-be77-8f179bdd564a admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.138608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d102f6-2e01-4727-be77-8f179bdd564a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.139404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d102f6-2e01-4727-be77-8f179bdd564a admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.140808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d102f6-2e01-4727-be77-8f179bdd564a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:02.146223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d102f6-2e01-4727-be77-8f179bdd564a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:02.153348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1263/2513] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:02.158327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3e56d-3d7f-4a83-a375-d85ee73877bc admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:02.170659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3e56d-3d7f-4a83-a375-d85ee73877bc admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:02.176687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a7943-ad32-467b-941c-a764f6a8c3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:02.177585 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7943-ad32-467b-941c-a764f6a8c3be admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.177867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7943-ad32-467b-941c-a764f6a8c3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.178141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7943-ad32-467b-941c-a764f6a8c3be admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.178878 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a7943-ad32-467b-941c-a764f6a8c3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:02.180634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a7943-ad32-467b-941c-a764f6a8c3be admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:02.195651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1251/2514] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:02.196666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d102f6-2e01-4727-be77-8f179bdd564a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:02.210817 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d102f6-2e01-4727-be77-8f179bdd564a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:02.216612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05551a-4559-4e45-9964-0aa411dce15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:02.218253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05551a-4559-4e45-9964-0aa411dce15b admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.223123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05551a-4559-4e45-9964-0aa411dce15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.223123 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05551a-4559-4e45-9964-0aa411dce15b admin admin] PATH_INFO: `/v3/projects/29c27e6e1f474d769888c732b4d2f4ef/users/f111551e2a784b4fbeded165f1711631/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.239287 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05551a-4559-4e45-9964-0aa411dce15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c27e6e1f474d769888c732b4d2f4ef, user_id=f111551e2a784b4fbeded165f1711631, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:02.239287 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05551a-4559-4e45-9964-0aa411dce15b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:02.355800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1264/2515] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:02 2022] PUT /identity/v3/projects/29c27e6e1f474d769888c732b4d2f4ef/users/f111551e2a784b4fbeded165f1711631/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:02.366630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db0564-5326-41e1-a3ca-b3660269758f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.366920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db0564-5326-41e1-a3ca-b3660269758f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.367230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db0564-5326-41e1-a3ca-b3660269758f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.383854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05551a-4559-4e45-9964-0aa411dce15b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:02.385605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7d05551a-4559-4e45-9964-0aa411dce15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:02.399637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-70db0564-5326-41e1-a3ca-b3660269758f None None] MFA Rules not processed for user `f111551e2a784b4fbeded165f1711631`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:02.400907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-70db0564-5326-41e1-a3ca-b3660269758f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:02.459348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05551a-4559-4e45-9964-0aa411dce15b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:02.464141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:02.465009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.465294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.465578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] PATH_INFO: `/v3/projects/0b682622cdb543c68a2245ff223f10e6` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.467018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b682622cdb543c68a2245ff223f10e6)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:02.469171 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:02.476856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1252/2516] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:02.481383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db0564-5326-41e1-a3ca-b3660269758f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:02.496975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db0564-5326-41e1-a3ca-b3660269758f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:02.503223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f0281-abb5-4e56-8107-b97513b8fbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:02.504276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f0281-abb5-4e56-8107-b97513b8fbda admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.504557 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f0281-abb5-4e56-8107-b97513b8fbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.504836 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f0281-abb5-4e56-8107-b97513b8fbda admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.505550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f0281-abb5-4e56-8107-b97513b8fbda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:02.507564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f0281-abb5-4e56-8107-b97513b8fbda admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:02.621251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b682622cdb543c68a2245ff223f10e6', 'request_id': 'req-4fbe6d71-0cb3-4ef1-a192-97433effe10d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:02.628422 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b682622cdb543c68a2245ff223f10e6', 'request_id': 'req-4fbe6d71-0cb3-4ef1-a192-97433effe10d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:02.629820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1253/2517] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:02 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:02.633338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f0281-abb5-4e56-8107-b97513b8fbda admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:02.635349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b682622cdb543c68a2245ff223f10e6', 'request_id': 'req-4fbe6d71-0cb3-4ef1-a192-97433effe10d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:02.637148 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:02.701058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f0281-abb5-4e56-8107-b97513b8fbda admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:02.705965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1be930-3b7f-4f7b-b5a6-a1691ae0e395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:02.706668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1be930-3b7f-4f7b-b5a6-a1691ae0e395 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.706963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1be930-3b7f-4f7b-b5a6-a1691ae0e395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.707241 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1be930-3b7f-4f7b-b5a6-a1691ae0e395 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.707955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1be930-3b7f-4f7b-b5a6-a1691ae0e395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:02.709953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1be930-3b7f-4f7b-b5a6-a1691ae0e395 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:02.793281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] The token cache is being invalidate because project 0b682622cdb543c68a2245ff223f10e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:02.793572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:02.794237 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-4fbe6d71-0cb3-4ef1-a192-97433effe10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:02.796605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1265/2518] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:02 2022] DELETE /identity/v3/projects/0b682622cdb543c68a2245ff223f10e6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:02.801419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225f47c-894c-414f-8e94-4df60cf5a59c None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.801714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225f47c-894c-414f-8e94-4df60cf5a59c None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.802000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225f47c-894c-414f-8e94-4df60cf5a59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.823729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6225f47c-894c-414f-8e94-4df60cf5a59c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:02.825003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6225f47c-894c-414f-8e94-4df60cf5a59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:02.829117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1254/2519] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:02 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:02.832948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1be930-3b7f-4f7b-b5a6-a1691ae0e395 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:02.834575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cb1be930-3b7f-4f7b-b5a6-a1691ae0e395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:02.836761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1266/2520] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:02.844339 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abfd3f-e797-4e1f-bb69-0a4010799e17 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.844762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abfd3f-e797-4e1f-bb69-0a4010799e17 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.844885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abfd3f-e797-4e1f-bb69-0a4010799e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.847415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1be930-3b7f-4f7b-b5a6-a1691ae0e395 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:02.852266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd559d35-a5aa-489e-b39b-9def3f4660c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:02.853019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559d35-a5aa-489e-b39b-9def3f4660c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.853313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559d35-a5aa-489e-b39b-9def3f4660c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.853595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559d35-a5aa-489e-b39b-9def3f4660c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.854320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd559d35-a5aa-489e-b39b-9def3f4660c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:02.856065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd559d35-a5aa-489e-b39b-9def3f4660c7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:02.866065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-72abfd3f-e797-4e1f-bb69-0a4010799e17 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:02.867357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-72abfd3f-e797-4e1f-bb69-0a4010799e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:02.868805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1255/2521] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:02.874508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd559d35-a5aa-489e-b39b-9def3f4660c7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:02.877689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1267/2522] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:02.881898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abfd3f-e797-4e1f-bb69-0a4010799e17 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:02.885084 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd559d35-a5aa-489e-b39b-9def3f4660c7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:02.890699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05b768-d15a-4041-a444-cab1f3bac29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:02.891673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05b768-d15a-4041-a444-cab1f3bac29e admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.891963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05b768-d15a-4041-a444-cab1f3bac29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.892159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abfd3f-e797-4e1f-bb69-0a4010799e17 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:02.892346 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05b768-d15a-4041-a444-cab1f3bac29e admin admin] PATH_INFO: `/v3/projects/c036fee30d3f4cffb6b8fdf400323500/users/22ccf21f8e1e48bb836914a48c062846/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.895842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:02.896695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5362-db69-43c7-9afe-f626f6475c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:02.907948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5362-db69-43c7-9afe-f626f6475c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.907948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5362-db69-43c7-9afe-f626f6475c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.907948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5362-db69-43c7-9afe-f626f6475c53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.907948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5362-db69-43c7-9afe-f626f6475c53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:02.907948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5362-db69-43c7-9afe-f626f6475c53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:02.907948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5362-db69-43c7-9afe-f626f6475c53 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:02.910148 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05b768-d15a-4041-a444-cab1f3bac29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c036fee30d3f4cffb6b8fdf400323500, user_id=22ccf21f8e1e48bb836914a48c062846, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:02.912852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05b768-d15a-4041-a444-cab1f3bac29e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:02.914170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1268/2523] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:50:02.918666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5362-db69-43c7-9afe-f626f6475c53 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:02.932777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5362-db69-43c7-9afe-f626f6475c53 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:02.938661 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b95803-8d0e-4dd5-b744-932d2a864638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:02.939598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95803-8d0e-4dd5-b744-932d2a864638 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:02.940261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95803-8d0e-4dd5-b744-932d2a864638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:02.940538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95803-8d0e-4dd5-b744-932d2a864638 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:02.941226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b95803-8d0e-4dd5-b744-932d2a864638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:02.943372 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b95803-8d0e-4dd5-b744-932d2a864638 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:03.052273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1256/2524] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:02 2022] PUT /identity/v3/projects/c036fee30d3f4cffb6b8fdf400323500/users/22ccf21f8e1e48bb836914a48c062846/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:03.056153 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05b768-d15a-4041-a444-cab1f3bac29e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:03.086810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1269/2525] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:02 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:03.091172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b95803-8d0e-4dd5-b744-932d2a864638 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:03.123965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05b768-d15a-4041-a444-cab1f3bac29e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:03.157064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b95803-8d0e-4dd5-b744-932d2a864638 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:03.161887 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96728dde-d723-44a1-a333-1990b25ddbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:03.162566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96728dde-d723-44a1-a333-1990b25ddbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.162852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96728dde-d723-44a1-a333-1990b25ddbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.163158 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96728dde-d723-44a1-a333-1990b25ddbe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.163846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96728dde-d723-44a1-a333-1990b25ddbe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:03.165808 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96728dde-d723-44a1-a333-1990b25ddbe7 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:03.188652 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0228502-8f74-42fd-b327-8d10b05ca974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:03.189325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0228502-8f74-42fd-b327-8d10b05ca974 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.189604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0228502-8f74-42fd-b327-8d10b05ca974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.189878 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0228502-8f74-42fd-b327-8d10b05ca974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.190599 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0228502-8f74-42fd-b327-8d10b05ca974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:03.192218 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0228502-8f74-42fd-b327-8d10b05ca974 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:03.203352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1257/2526] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:03.207676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0228502-8f74-42fd-b327-8d10b05ca974 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:03.217874 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0228502-8f74-42fd-b327-8d10b05ca974 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:03.222521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a49b9-0ee4-4711-9308-a2ef653bb0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:03.223412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a49b9-0ee4-4711-9308-a2ef653bb0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.223696 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a49b9-0ee4-4711-9308-a2ef653bb0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.223971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a49b9-0ee4-4711-9308-a2ef653bb0b7 admin admin] PATH_INFO: `/v3/projects/c036fee30d3f4cffb6b8fdf400323500/users/22ccf21f8e1e48bb836914a48c062846/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.226046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a49b9-0ee4-4711-9308-a2ef653bb0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c036fee30d3f4cffb6b8fdf400323500, user_id=22ccf21f8e1e48bb836914a48c062846, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:03.228740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a49b9-0ee4-4711-9308-a2ef653bb0b7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:03.245668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1258/2527] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:03 2022] PUT /identity/v3/projects/c036fee30d3f4cffb6b8fdf400323500/users/22ccf21f8e1e48bb836914a48c062846/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:03.257894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7f04-1e43-45c2-b05f-058821b688b5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.258153 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7f04-1e43-45c2-b05f-058821b688b5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.258431 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7f04-1e43-45c2-b05f-058821b688b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.287799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-287e7f04-1e43-45c2-b05f-058821b688b5 None None] MFA Rules not processed for user `22ccf21f8e1e48bb836914a48c062846`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:03.289120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-287e7f04-1e43-45c2-b05f-058821b688b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:03.312546 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1270/2528] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:03 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:03.313720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96728dde-d723-44a1-a333-1990b25ddbe7 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:03.324540 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96728dde-d723-44a1-a333-1990b25ddbe7 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:03.365610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:03.370496 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1259/2529] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:03.382901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e7f04-1e43-45c2-b05f-058821b688b5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:03.384428 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-287e7f04-1e43-45c2-b05f-058821b688b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:03.390165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5523de-6f96-44cf-9262-ba3eb7565c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:03.390880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5523de-6f96-44cf-9262-ba3eb7565c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.391172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5523de-6f96-44cf-9262-ba3eb7565c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.391515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5523de-6f96-44cf-9262-ba3eb7565c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.392459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5523de-6f96-44cf-9262-ba3eb7565c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:03.394092 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5523de-6f96-44cf-9262-ba3eb7565c51 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:03.404812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1271/2530] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:03.415338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5523de-6f96-44cf-9262-ba3eb7565c51 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:03.427106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5523de-6f96-44cf-9262-ba3eb7565c51 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:03.432127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b671e6-b339-4bbb-8293-b01526a84729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:03.432811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b671e6-b339-4bbb-8293-b01526a84729 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.433100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b671e6-b339-4bbb-8293-b01526a84729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.433378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b671e6-b339-4bbb-8293-b01526a84729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.434105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b671e6-b339-4bbb-8293-b01526a84729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:03.438191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b671e6-b339-4bbb-8293-b01526a84729 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:03.448246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1272/2531] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:03.451074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e7f04-1e43-45c2-b05f-058821b688b5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:03.452561 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b671e6-b339-4bbb-8293-b01526a84729 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:03.456565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f2c79-9ad1-46a5-b813-bb9f4806dbc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:03.457236 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f2c79-9ad1-46a5-b813-bb9f4806dbc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.457640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f2c79-9ad1-46a5-b813-bb9f4806dbc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.457915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f2c79-9ad1-46a5-b813-bb9f4806dbc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.463049 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b671e6-b339-4bbb-8293-b01526a84729 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:03.468821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f2c79-9ad1-46a5-b813-bb9f4806dbc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:03.469208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5388d02-fa66-4fb9-8ec3-ed4c5522dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:03.470113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5388d02-fa66-4fb9-8ec3-ed4c5522dcbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.470278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f2c79-9ad1-46a5-b813-bb9f4806dbc4 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:03.470393 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5388d02-fa66-4fb9-8ec3-ed4c5522dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.470656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5388d02-fa66-4fb9-8ec3-ed4c5522dcbe admin admin] PATH_INFO: `/v3/projects/feb1014adaaf4d85b4d4b54e2156b9aa/users/330fd103504f4eaabc25a4dcd3598304/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.486485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1260/2532] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:03.488831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5388d02-fa66-4fb9-8ec3-ed4c5522dcbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb1014adaaf4d85b4d4b54e2156b9aa, user_id=330fd103504f4eaabc25a4dcd3598304, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:03.491628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5388d02-fa66-4fb9-8ec3-ed4c5522dcbe admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:03.495415 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:03.604134 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1273/2533] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:03 2022] PUT /identity/v3/projects/feb1014adaaf4d85b4d4b54e2156b9aa/users/330fd103504f4eaabc25a4dcd3598304/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:03.618223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc21d8-acde-450f-834a-651a3302d5a5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.622413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc21d8-acde-450f-834a-651a3302d5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.622413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc21d8-acde-450f-834a-651a3302d5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.650673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-34cc21d8-acde-450f-834a-651a3302d5a5 None None] MFA Rules not processed for user `330fd103504f4eaabc25a4dcd3598304`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:03.652800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-34cc21d8-acde-450f-834a-651a3302d5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:03.718625 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1261/2534] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:03.723161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5388d02-fa66-4fb9-8ec3-ed4c5522dcbe admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:03.771679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc21d8-acde-450f-834a-651a3302d5a5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:03.792730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5388d02-fa66-4fb9-8ec3-ed4c5522dcbe admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:03.801196 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763afbd-e54b-415c-bcc3-e12d3b399f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:03.801875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763afbd-e54b-415c-bcc3-e12d3b399f0e admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.802155 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763afbd-e54b-415c-bcc3-e12d3b399f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.802431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763afbd-e54b-415c-bcc3-e12d3b399f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.803131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763afbd-e54b-415c-bcc3-e12d3b399f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:03.805404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763afbd-e54b-415c-bcc3-e12d3b399f0e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:03.835155 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc21d8-acde-450f-834a-651a3302d5a5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:03.839155 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b04d1-ee46-4113-82f3-c4819c376498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:03.839896 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b04d1-ee46-4113-82f3-c4819c376498 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:03.840220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b04d1-ee46-4113-82f3-c4819c376498 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:03.840504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b04d1-ee46-4113-82f3-c4819c376498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:03.843714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-080b04d1-ee46-4113-82f3-c4819c376498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:03.896889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:03.911370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b04d1-ee46-4113-82f3-c4819c376498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:03.912945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b04d1-ee46-4113-82f3-c4819c376498 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:03.917266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1274/2535] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:03 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:03.918558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763afbd-e54b-415c-bcc3-e12d3b399f0e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:03.924904 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1262/2536] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:03.991665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763afbd-e54b-415c-bcc3-e12d3b399f0e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:04.000876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4239-3ea7-425d-ba2b-555b17d7faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:04.001574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4239-3ea7-425d-ba2b-555b17d7faab admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:04.001862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4239-3ea7-425d-ba2b-555b17d7faab admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:04.002140 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4239-3ea7-425d-ba2b-555b17d7faab admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:04.002833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a4239-3ea7-425d-ba2b-555b17d7faab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:04.004867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a4239-3ea7-425d-ba2b-555b17d7faab admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:04.135166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1275/2537] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:03 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:04.139630 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b04d1-ee46-4113-82f3-c4819c376498 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:04.150374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b04d1-ee46-4113-82f3-c4819c376498 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:04.155785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe8316-ce04-4c73-b9c8-b643c90453d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:04.156483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe8316-ce04-4c73-b9c8-b643c90453d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:04.156764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe8316-ce04-4c73-b9c8-b643c90453d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:04.157070 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe8316-ce04-4c73-b9c8-b643c90453d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:04.157757 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe8316-ce04-4c73-b9c8-b643c90453d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:04.159347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe8316-ce04-4c73-b9c8-b643c90453d0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:04.169365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1263/2538] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:04.174476 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4239-3ea7-425d-ba2b-555b17d7faab admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:04.184746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4239-3ea7-425d-ba2b-555b17d7faab admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:04.191041 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ddc8a-8580-4a9b-96db-e66fc6cacb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:04.192137 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ddc8a-8580-4a9b-96db-e66fc6cacb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:04.192430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ddc8a-8580-4a9b-96db-e66fc6cacb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:04.192719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ddc8a-8580-4a9b-96db-e66fc6cacb3b admin admin] PATH_INFO: `/v3/projects/e6b40f2e54b6438297a85e312f8b3b1d/users/377341fe3815493ea063ba0a202f9472/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:04.207930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ddc8a-8580-4a9b-96db-e66fc6cacb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b40f2e54b6438297a85e312f8b3b1d, user_id=377341fe3815493ea063ba0a202f9472, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:04.210699 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ddc8a-8580-4a9b-96db-e66fc6cacb3b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:04.308593 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1276/2539] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:04 2022] PUT /identity/v3/projects/e6b40f2e54b6438297a85e312f8b3b1d/users/377341fe3815493ea063ba0a202f9472/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:04.313877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe8316-ce04-4c73-b9c8-b643c90453d0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:04.329716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe8316-ce04-4c73-b9c8-b643c90453d0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:04.393066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca107414-8389-405b-bba8-635e04906785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:04.393783 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca107414-8389-405b-bba8-635e04906785 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:04.394061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca107414-8389-405b-bba8-635e04906785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:04.394364 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca107414-8389-405b-bba8-635e04906785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:04.395269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca107414-8389-405b-bba8-635e04906785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:04.396916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca107414-8389-405b-bba8-635e04906785 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:04.413269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1264/2540] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:04.417723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ddc8a-8580-4a9b-96db-e66fc6cacb3b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:04.430944 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ddc8a-8580-4a9b-96db-e66fc6cacb3b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:04.437652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef47d9-23b3-4334-9a72-ddfe5b39e582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:04.438756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef47d9-23b3-4334-9a72-ddfe5b39e582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:04.439306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef47d9-23b3-4334-9a72-ddfe5b39e582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:04.439684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef47d9-23b3-4334-9a72-ddfe5b39e582 admin admin] PATH_INFO: `/v3/projects/e6b40f2e54b6438297a85e312f8b3b1d/users/377341fe3815493ea063ba0a202f9472/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:04.445011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef47d9-23b3-4334-9a72-ddfe5b39e582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b40f2e54b6438297a85e312f8b3b1d, user_id=377341fe3815493ea063ba0a202f9472, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:04.449891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef47d9-23b3-4334-9a72-ddfe5b39e582 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:04.460985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1277/2541] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:04 2022] PUT /identity/v3/projects/e6b40f2e54b6438297a85e312f8b3b1d/users/377341fe3815493ea063ba0a202f9472/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:04.472057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec8eb0-6229-47b8-89e6-6414c299106d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:04.472515 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec8eb0-6229-47b8-89e6-6414c299106d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:04.472802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec8eb0-6229-47b8-89e6-6414c299106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:04.501096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-cfec8eb0-6229-47b8-89e6-6414c299106d None None] MFA Rules not processed for user `377341fe3815493ea063ba0a202f9472`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:04.502313 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cfec8eb0-6229-47b8-89e6-6414c299106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:04.584972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1265/2542] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:04 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:04.597530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef47d9-23b3-4334-9a72-ddfe5b39e582 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:04.632705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:04.655654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef47d9-23b3-4334-9a72-ddfe5b39e582 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:04.659692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabed973-4796-4846-894f-e3487a7332d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:04.660463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabed973-4796-4846-894f-e3487a7332d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:04.660749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabed973-4796-4846-894f-e3487a7332d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:04.661040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabed973-4796-4846-894f-e3487a7332d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:04.671643 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabed973-4796-4846-894f-e3487a7332d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:04.673136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabed973-4796-4846-894f-e3487a7332d8 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:04.683296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1278/2543] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:04 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:04.792285 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec8eb0-6229-47b8-89e6-6414c299106d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:04.793710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cfec8eb0-6229-47b8-89e6-6414c299106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:04.812765 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec8eb0-6229-47b8-89e6-6414c299106d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:04.818276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8199cc8-6f82-49b2-a8b5-4f74a8780a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:04.819018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8199cc8-6f82-49b2-a8b5-4f74a8780a3d service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:04.819307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8199cc8-6f82-49b2-a8b5-4f74a8780a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:04.819581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8199cc8-6f82-49b2-a8b5-4f74a8780a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:04.879459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:04.882012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8199cc8-6f82-49b2-a8b5-4f74a8780a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:04.883510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8199cc8-6f82-49b2-a8b5-4f74a8780a3d service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:04.894482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1266/2544] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:07.822579 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabed973-4796-4846-894f-e3487a7332d8 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:07.903557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabed973-4796-4846-894f-e3487a7332d8 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:07.910253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:07.911175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:07.911460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:07.911736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] PATH_INFO: `/v3/users/f111551e2a784b4fbeded165f1711631` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:07.912994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f111551e2a784b4fbeded165f1711631)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:07.915006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:08.140401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f111551e2a784b4fbeded165f1711631'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:08.158466 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f111551e2a784b4fbeded165f1711631'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:08.277059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f111551e2a784b4fbeded165f1711631'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:08.277681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f111551e2a784b4fbeded165f1711631'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:08.278284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f111551e2a784b4fbeded165f1711631'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:08.294745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1279/2545] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:07 2022] DELETE /identity/v3/users/f111551e2a784b4fbeded165f1711631 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:08.299900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b56331-d7e6-4a41-8d4b-013df74eea7c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:08.300520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b56331-d7e6-4a41-8d4b-013df74eea7c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:08.300607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b56331-d7e6-4a41-8d4b-013df74eea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:08.318124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a1b56331-d7e6-4a41-8d4b-013df74eea7c None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:08.319334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a1b56331-d7e6-4a41-8d4b-013df74eea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:08.387917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1267/2546] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:08.398022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:08.399711 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:08.463374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e881d2-562b-49a9-beb5-0b40c52dd23d admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:08.468873 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5fdae-63ce-4501-b32a-bc6fe73a21fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:08.469617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5fdae-63ce-4501-b32a-bc6fe73a21fb service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:08.469905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5fdae-63ce-4501-b32a-bc6fe73a21fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:08.470184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5fdae-63ce-4501-b32a-bc6fe73a21fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:08.479839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:08.482268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5fdae-63ce-4501-b32a-bc6fe73a21fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:08.485135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5fdae-63ce-4501-b32a-bc6fe73a21fb service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:08.495765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1280/2547] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:08.931557 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b56331-d7e6-4a41-8d4b-013df74eea7c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:08.933112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a1b56331-d7e6-4a41-8d4b-013df74eea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:08.946410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b56331-d7e6-4a41-8d4b-013df74eea7c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:08.954506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:08.954871 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:08.955233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:08.955594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] PATH_INFO: `/v3/projects/29c27e6e1f474d769888c732b4d2f4ef` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:08.956966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c27e6e1f474d769888c732b4d2f4ef)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:08.959069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:09.126284 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c27e6e1f474d769888c732b4d2f4ef', 'request_id': 'req-2f15c9b8-b607-4004-ae2c-a0d052e94f43'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:09.134502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c27e6e1f474d769888c732b4d2f4ef', 'request_id': 'req-2f15c9b8-b607-4004-ae2c-a0d052e94f43'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:09.254597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c27e6e1f474d769888c732b4d2f4ef', 'request_id': 'req-2f15c9b8-b607-4004-ae2c-a0d052e94f43'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:09.269156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] The token cache is being invalidate because project 29c27e6e1f474d769888c732b4d2f4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:09.269615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:09.270341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:09.272005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1268/2548] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:08 2022] DELETE /identity/v3/projects/29c27e6e1f474d769888c732b4d2f4ef => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:09.276132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5fdae-63ce-4501-b32a-bc6fe73a21fb service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:09.286598 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5fdae-63ce-4501-b32a-bc6fe73a21fb service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:09.346999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:09.347903 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:09.348217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:09.348502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] PATH_INFO: `/v3/users/22ccf21f8e1e48bb836914a48c062846` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:09.349731 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ccf21f8e1e48bb836914a48c062846)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:09.351700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:09.636357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ccf21f8e1e48bb836914a48c062846'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:09.649238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ccf21f8e1e48bb836914a48c062846'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:09.724530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ccf21f8e1e48bb836914a48c062846'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:09.725154 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ccf21f8e1e48bb836914a48c062846'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:09.725757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ccf21f8e1e48bb836914a48c062846'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:09.740363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1281/2549] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:09 2022] DELETE /identity/v3/users/22ccf21f8e1e48bb836914a48c062846 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:10.264839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:10.266099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:10.280186 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15c9b8-b607-4004-ae2c-a0d052e94f43 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:10.345284 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:10.346164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:10.346449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:10.346740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] PATH_INFO: `/v3/projects/c036fee30d3f4cffb6b8fdf400323500` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:10.347495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:10.348059 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c036fee30d3f4cffb6b8fdf400323500)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:10.349036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:10.350007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:10.362872 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ffb32-f189-4dda-8957-4f6ac0ce5996 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:10.369945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:10.370917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:10.371274 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:10.371622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] PATH_INFO: `/v3/users/330fd103504f4eaabc25a4dcd3598304` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:10.372950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] RBAC: Authorizing `identity:delete_user(user_id=330fd103504f4eaabc25a4dcd3598304)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:10.374980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:10.375508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:10.449453 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c036fee30d3f4cffb6b8fdf400323500', 'request_id': 'req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:10.455678 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c036fee30d3f4cffb6b8fdf400323500', 'request_id': 'req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:10.530571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c036fee30d3f4cffb6b8fdf400323500', 'request_id': 'req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:10.542462 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] The token cache is being invalidate because project c036fee30d3f4cffb6b8fdf400323500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:10.544688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:10.544688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d4722586-c1e4-467c-b0cc-04a0f5c31eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:10.545267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1269/2550] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:10 2022] DELETE /identity/v3/projects/c036fee30d3f4cffb6b8fdf400323500 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:10.551627 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fbd7f-ecc8-47f8-ad50-8c6d9a90dfe2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:10.551913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fbd7f-ecc8-47f8-ad50-8c6d9a90dfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:10.552237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fbd7f-ecc8-47f8-ad50-8c6d9a90dfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:10.579038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8c3fbd7f-ecc8-47f8-ad50-8c6d9a90dfe2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:10.579747 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8c3fbd7f-ecc8-47f8-ad50-8c6d9a90dfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:10.597389 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330fd103504f4eaabc25a4dcd3598304'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:10.615770 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330fd103504f4eaabc25a4dcd3598304'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:10.620147 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:10.652140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1270/2551] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:10.660442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f06f7-08d5-4fd4-aae4-d3e7a99a52c5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:10.660734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f06f7-08d5-4fd4-aae4-d3e7a99a52c5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:10.661022 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f06f7-08d5-4fd4-aae4-d3e7a99a52c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:10.682118 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1d3f06f7-08d5-4fd4-aae4-d3e7a99a52c5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:10.683334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1d3f06f7-08d5-4fd4-aae4-d3e7a99a52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:10.694105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1271/2552] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:10.696096 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330fd103504f4eaabc25a4dcd3598304'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:10.696845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330fd103504f4eaabc25a4dcd3598304'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:10.698347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-84a63a09-7909-4aa7-a2f5-95295ec2627d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330fd103504f4eaabc25a4dcd3598304'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:10.698576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f06f7-08d5-4fd4-aae4-d3e7a99a52c5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:10.709860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f06f7-08d5-4fd4-aae4-d3e7a99a52c5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:10.713371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1282/2553] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:10 2022] DELETE /identity/v3/users/330fd103504f4eaabc25a4dcd3598304 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:10.726812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f4d96-30db-48c4-9660-38e8c4ccd4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:10.726812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f4d96-30db-48c4-9660-38e8c4ccd4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:10.726812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f4d96-30db-48c4-9660-38e8c4ccd4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:10.726812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f4d96-30db-48c4-9660-38e8c4ccd4ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:10.727525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f4d96-30db-48c4-9660-38e8c4ccd4ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:10.727525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f4d96-30db-48c4-9660-38e8c4ccd4ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:10.727525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f4d96-30db-48c4-9660-38e8c4ccd4ce admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:10.729098 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418191a-733f-4a42-9f32-98a76d3fad02 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:10.729522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418191a-733f-4a42-9f32-98a76d3fad02 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:10.730308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418191a-733f-4a42-9f32-98a76d3fad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:10.741225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1272/2554] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:50:10.741225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f4d96-30db-48c4-9660-38e8c4ccd4ce admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:10.742082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9b3f4d96-30db-48c4-9660-38e8c4ccd4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:10.750896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9418191a-733f-4a42-9f32-98a76d3fad02 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:10.752337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9418191a-733f-4a42-9f32-98a76d3fad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:10.755997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f4d96-30db-48c4-9660-38e8c4ccd4ce admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:10.814495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fcd28-8b97-4030-9027-03b657e90bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:10.815074 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fcd28-8b97-4030-9027-03b657e90bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:10.815293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1283/2555] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:10.818820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fcd28-8b97-4030-9027-03b657e90bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:10.818820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fcd28-8b97-4030-9027-03b657e90bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:10.818820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fcd28-8b97-4030-9027-03b657e90bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:10.818820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fcd28-8b97-4030-9027-03b657e90bf3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:10.827336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418191a-733f-4a42-9f32-98a76d3fad02 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:10.829085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9418191a-733f-4a42-9f32-98a76d3fad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:10.885956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1273/2556] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:10 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:10.890489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fcd28-8b97-4030-9027-03b657e90bf3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:10.893325 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418191a-733f-4a42-9f32-98a76d3fad02 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:10.955157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e933-5d06-4e5e-ad82-687449d0e6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:10.955825 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e933-5d06-4e5e-ad82-687449d0e6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:10.956125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e933-5d06-4e5e-ad82-687449d0e6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:10.956402 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e933-5d06-4e5e-ad82-687449d0e6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:10.959550 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fcd28-8b97-4030-9027-03b657e90bf3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:10.964395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc63ee8-67ff-45ad-a6ff-1d1238fe2b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:10.965072 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc63ee8-67ff-45ad-a6ff-1d1238fe2b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:10.965359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc63ee8-67ff-45ad-a6ff-1d1238fe2b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:10.965669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc63ee8-67ff-45ad-a6ff-1d1238fe2b28 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:10.966430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc63ee8-67ff-45ad-a6ff-1d1238fe2b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:10.966546 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7e933-5d06-4e5e-ad82-687449d0e6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:10.968328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7e933-5d06-4e5e-ad82-687449d0e6f1 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:10.968575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc63ee8-67ff-45ad-a6ff-1d1238fe2b28 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:10.979209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1284/2557] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:10.987965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:11.062612 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1274/2558] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:10 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:11.069145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e933-5d06-4e5e-ad82-687449d0e6f1 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:11.079753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e933-5d06-4e5e-ad82-687449d0e6f1 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:11.085252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6dd3e-9489-447b-9c9e-0d739fbbdc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:11.085930 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6dd3e-9489-447b-9c9e-0d739fbbdc21 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:11.086216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6dd3e-9489-447b-9c9e-0d739fbbdc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:11.086492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6dd3e-9489-447b-9c9e-0d739fbbdc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:11.087222 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6dd3e-9489-447b-9c9e-0d739fbbdc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:11.088940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6dd3e-9489-447b-9c9e-0d739fbbdc21 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:11.100215 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1285/2559] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:11.104237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc63ee8-67ff-45ad-a6ff-1d1238fe2b28 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:11.115260 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc63ee8-67ff-45ad-a6ff-1d1238fe2b28 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:11.119969 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a0ba7-e581-42e1-a946-a333c0514981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:11.120804 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a0ba7-e581-42e1-a946-a333c0514981 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:11.121075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a0ba7-e581-42e1-a946-a333c0514981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:11.121355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a0ba7-e581-42e1-a946-a333c0514981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:11.122083 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a0ba7-e581-42e1-a946-a333c0514981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:11.124912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a0ba7-e581-42e1-a946-a333c0514981 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:11.135589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1275/2560] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:11.146567 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6dd3e-9489-447b-9c9e-0d739fbbdc21 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:11.157161 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6dd3e-9489-447b-9c9e-0d739fbbdc21 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:11.161885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86769b39-35c1-4b19-a1cf-fb9efd44def0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:11.162771 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86769b39-35c1-4b19-a1cf-fb9efd44def0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:11.163199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86769b39-35c1-4b19-a1cf-fb9efd44def0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:11.163469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86769b39-35c1-4b19-a1cf-fb9efd44def0 admin admin] PATH_INFO: `/v3/projects/86fd596ae40547798d3810bd6c7ef456/users/c6bf8cbf09d0471f948c268c152a25ca/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:11.179782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86769b39-35c1-4b19-a1cf-fb9efd44def0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fd596ae40547798d3810bd6c7ef456, user_id=c6bf8cbf09d0471f948c268c152a25ca, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:11.182636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86769b39-35c1-4b19-a1cf-fb9efd44def0 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:11.321649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1286/2561] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:11 2022] PUT /identity/v3/projects/86fd596ae40547798d3810bd6c7ef456/users/c6bf8cbf09d0471f948c268c152a25ca/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:11.336016 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8370-df27-473b-ad2c-06df29aa34c1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:11.336443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8370-df27-473b-ad2c-06df29aa34c1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:11.336524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8370-df27-473b-ad2c-06df29aa34c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:11.382297 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5e7b8370-df27-473b-ad2c-06df29aa34c1 None None] MFA Rules not processed for user `c6bf8cbf09d0471f948c268c152a25ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:11.384486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5e7b8370-df27-473b-ad2c-06df29aa34c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:11.475653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1276/2562] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:11.489065 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86769b39-35c1-4b19-a1cf-fb9efd44def0 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:11.504205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:11.557202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86769b39-35c1-4b19-a1cf-fb9efd44def0 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:11.563387 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001da86-b4a0-40af-ae7f-e9623c799886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:11.565746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001da86-b4a0-40af-ae7f-e9623c799886 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:11.565746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001da86-b4a0-40af-ae7f-e9623c799886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:11.565746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001da86-b4a0-40af-ae7f-e9623c799886 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:11.565746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001da86-b4a0-40af-ae7f-e9623c799886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:11.567337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001da86-b4a0-40af-ae7f-e9623c799886 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:11.600613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b8370-df27-473b-ad2c-06df29aa34c1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:11.608312 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5e7b8370-df27-473b-ad2c-06df29aa34c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:11.617096 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b8370-df27-473b-ad2c-06df29aa34c1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:11.622589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:11.624012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:11.624349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:11.624629 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] PATH_INFO: `/v3/projects/feb1014adaaf4d85b4d4b54e2156b9aa` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:11.625855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb1014adaaf4d85b4d4b54e2156b9aa)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:11.627859 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:11.719686 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1287/2563] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:11 2022] POST /identity/v3/projects => generated 377 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:11.723922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001da86-b4a0-40af-ae7f-e9623c799886 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:11.770780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb1014adaaf4d85b4d4b54e2156b9aa', 'request_id': 'req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:11.783175 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb1014adaaf4d85b4d4b54e2156b9aa', 'request_id': 'req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:11.799784 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001da86-b4a0-40af-ae7f-e9623c799886 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:11.868708 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ecc2b-e18f-4375-b409-6f45c81e9820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:11.872225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ecc2b-e18f-4375-b409-6f45c81e9820 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:11.872225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ecc2b-e18f-4375-b409-6f45c81e9820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:11.872225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ecc2b-e18f-4375-b409-6f45c81e9820 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:11.872225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ecc2b-e18f-4375-b409-6f45c81e9820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:11.872848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ecc2b-e18f-4375-b409-6f45c81e9820 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:11.895927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb1014adaaf4d85b4d4b54e2156b9aa', 'request_id': 'req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:11.909844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] The token cache is being invalidate because project feb1014adaaf4d85b4d4b54e2156b9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:11.910109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:11.910966 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:11.912807 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1277/2564] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:11 2022] DELETE /identity/v3/projects/feb1014adaaf4d85b4d4b54e2156b9aa => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:11.917340 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:11.918721 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:11.934079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4169c-fb0d-4d26-80f1-2c39e101d3b9 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:11.939035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:11.939925 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:11.940265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:11.940545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] PATH_INFO: `/v3/users/377341fe3815493ea063ba0a202f9472` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:11.941753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=377341fe3815493ea063ba0a202f9472)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:11.943947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:11.945985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:12.000748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1288/2565] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:11 2022] POST /identity/v3/users => generated 295 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:12.004684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ecc2b-e18f-4375-b409-6f45c81e9820 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:12.006380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-418ecc2b-e18f-4375-b409-6f45c81e9820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:12.019246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ecc2b-e18f-4375-b409-6f45c81e9820 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:12.024511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742072b5-c065-48e7-b247-5008a070ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:12.025239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742072b5-c065-48e7-b247-5008a070ca85 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:12.025531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742072b5-c065-48e7-b247-5008a070ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:12.025813 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742072b5-c065-48e7-b247-5008a070ca85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:12.026594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742072b5-c065-48e7-b247-5008a070ca85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:12.030491 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742072b5-c065-48e7-b247-5008a070ca85 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:12.040168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1289/2566] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:12.045757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742072b5-c065-48e7-b247-5008a070ca85 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:12.056554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742072b5-c065-48e7-b247-5008a070ca85 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:12.062136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da12c2-77fc-4daa-97a6-d79a8620b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:12.063031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da12c2-77fc-4daa-97a6-d79a8620b96b admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:12.063349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da12c2-77fc-4daa-97a6-d79a8620b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:12.063632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da12c2-77fc-4daa-97a6-d79a8620b96b admin admin] PATH_INFO: `/v3/projects/817f7c7313e04b67813252ab6fc9d212/users/282c1ea5c5274cf1a33497ae35bc7e3d/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:12.081487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da12c2-77fc-4daa-97a6-d79a8620b96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=817f7c7313e04b67813252ab6fc9d212, user_id=282c1ea5c5274cf1a33497ae35bc7e3d, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:12.084178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da12c2-77fc-4daa-97a6-d79a8620b96b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:12.179153 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377341fe3815493ea063ba0a202f9472'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:12.192563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377341fe3815493ea063ba0a202f9472'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:12.205946 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:12.211624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1290/2567] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:12 2022] PUT /identity/v3/projects/817f7c7313e04b67813252ab6fc9d212/users/282c1ea5c5274cf1a33497ae35bc7e3d/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:12.215723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da12c2-77fc-4daa-97a6-d79a8620b96b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:12.270114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377341fe3815493ea063ba0a202f9472'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:12.271036 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377341fe3815493ea063ba0a202f9472'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:12.272536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377341fe3815493ea063ba0a202f9472'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:12.283027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da12c2-77fc-4daa-97a6-d79a8620b96b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:12.287237 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1278/2568] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:11 2022] DELETE /identity/v3/users/377341fe3815493ea063ba0a202f9472 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:12.287934 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab929-695a-4bc5-a26b-20a83353ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:12.288704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab929-695a-4bc5-a26b-20a83353ad5f admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:12.288990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab929-695a-4bc5-a26b-20a83353ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:12.289268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab929-695a-4bc5-a26b-20a83353ad5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:12.290024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab929-695a-4bc5-a26b-20a83353ad5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:12.291633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab929-695a-4bc5-a26b-20a83353ad5f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:12.304667 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1291/2569] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:12.314139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:12.314139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:12.386887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab70220-256c-43ab-8e91-79bb4c283f26 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:12.392614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116861e-b28a-4dfa-9700-8d6b3cc0e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:12.393560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116861e-b28a-4dfa-9700-8d6b3cc0e4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:12.394111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116861e-b28a-4dfa-9700-8d6b3cc0e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:12.394339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116861e-b28a-4dfa-9700-8d6b3cc0e4a1 admin admin] PATH_INFO: `/v3/projects/817f7c7313e04b67813252ab6fc9d212/users/282c1ea5c5274cf1a33497ae35bc7e3d/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:12.396497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116861e-b28a-4dfa-9700-8d6b3cc0e4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817f7c7313e04b67813252ab6fc9d212, user_id=282c1ea5c5274cf1a33497ae35bc7e3d, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:12.399203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116861e-b28a-4dfa-9700-8d6b3cc0e4a1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:12.411739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1279/2570] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:12 2022] PUT /identity/v3/projects/817f7c7313e04b67813252ab6fc9d212/users/282c1ea5c5274cf1a33497ae35bc7e3d/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:12.424132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2478d-5f5d-429f-ae17-1e5d1c12fb7f None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:12.424447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2478d-5f5d-429f-ae17-1e5d1c12fb7f None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:12.424707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2478d-5f5d-429f-ae17-1e5d1c12fb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:12.457552 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9ae2478d-5f5d-429f-ae17-1e5d1c12fb7f None None] MFA Rules not processed for user `282c1ea5c5274cf1a33497ae35bc7e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:12.458674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9ae2478d-5f5d-429f-ae17-1e5d1c12fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:12.528443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1292/2571] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:12.540692 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116861e-b28a-4dfa-9700-8d6b3cc0e4a1 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:12.542474 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9116861e-b28a-4dfa-9700-8d6b3cc0e4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:12.628744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116861e-b28a-4dfa-9700-8d6b3cc0e4a1 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:12.642318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315151f0-a7ac-4e8b-b670-5a9268d872a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:12.642318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315151f0-a7ac-4e8b-b670-5a9268d872a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:12.642318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315151f0-a7ac-4e8b-b670-5a9268d872a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:12.642318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315151f0-a7ac-4e8b-b670-5a9268d872a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:12.642858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-315151f0-a7ac-4e8b-b670-5a9268d872a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:12.664127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:12.708064 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315151f0-a7ac-4e8b-b670-5a9268d872a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:12.709456 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315151f0-a7ac-4e8b-b670-5a9268d872a3 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:12.719054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1280/2572] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:12.889835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2478d-5f5d-429f-ae17-1e5d1c12fb7f None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:12.891323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9ae2478d-5f5d-429f-ae17-1e5d1c12fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:12.963555 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2478d-5f5d-429f-ae17-1e5d1c12fb7f None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:12.968506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:12.969380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:12.969665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:12.969957 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] PATH_INFO: `/v3/projects/e6b40f2e54b6438297a85e312f8b3b1d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:12.971143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b40f2e54b6438297a85e312f8b3b1d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:12.973088 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:12.998439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:13.128319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b40f2e54b6438297a85e312f8b3b1d', 'request_id': 'req-64bc0dd0-e29f-464e-af6c-e7ded898edd5'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:13.133793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b40f2e54b6438297a85e312f8b3b1d', 'request_id': 'req-64bc0dd0-e29f-464e-af6c-e7ded898edd5'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:13.140507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b40f2e54b6438297a85e312f8b3b1d', 'request_id': 'req-64bc0dd0-e29f-464e-af6c-e7ded898edd5'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:13.244323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] The token cache is being invalidate because project e6b40f2e54b6438297a85e312f8b3b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:13.244621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:13.245287 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-64bc0dd0-e29f-464e-af6c-e7ded898edd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:13.246882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1293/2573] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:12 2022] DELETE /identity/v3/projects/e6b40f2e54b6438297a85e312f8b3b1d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:13.252768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95012aa7-537d-401a-9f85-a99b59c61bd6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:13.253058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95012aa7-537d-401a-9f85-a99b59c61bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:13.253339 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95012aa7-537d-401a-9f85-a99b59c61bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:13.272395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-95012aa7-537d-401a-9f85-a99b59c61bd6 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:13.273604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-95012aa7-537d-401a-9f85-a99b59c61bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:13.334123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1281/2574] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:13.343405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534acf-4638-4c70-ba35-d589b16df456 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:13.343702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534acf-4638-4c70-ba35-d589b16df456 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:13.344011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534acf-4638-4c70-ba35-d589b16df456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:13.364498 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-35534acf-4638-4c70-ba35-d589b16df456 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:13.365770 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-35534acf-4638-4c70-ba35-d589b16df456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:13.374229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1294/2575] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:13.378752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95012aa7-537d-401a-9f85-a99b59c61bd6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:13.389823 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95012aa7-537d-401a-9f85-a99b59c61bd6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:13.394452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babf497-3f3b-4fff-a72f-dff16510925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:13.395136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babf497-3f3b-4fff-a72f-dff16510925f admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:13.395423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babf497-3f3b-4fff-a72f-dff16510925f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:13.395705 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babf497-3f3b-4fff-a72f-dff16510925f admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:13.396466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babf497-3f3b-4fff-a72f-dff16510925f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:13.396777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babf497-3f3b-4fff-a72f-dff16510925f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:13.398386 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babf497-3f3b-4fff-a72f-dff16510925f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:13.411242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1282/2576] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:50:13.415829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534acf-4638-4c70-ba35-d589b16df456 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:13.426328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534acf-4638-4c70-ba35-d589b16df456 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:13.431017 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb06a-2a01-4f74-8f39-cc20176e83de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:13.431673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb06a-2a01-4f74-8f39-cc20176e83de admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:13.431996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb06a-2a01-4f74-8f39-cc20176e83de admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:13.432302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb06a-2a01-4f74-8f39-cc20176e83de admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:13.432993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdb06a-2a01-4f74-8f39-cc20176e83de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:13.434868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdb06a-2a01-4f74-8f39-cc20176e83de admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:13.537798 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1295/2577] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:13 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:13.543604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babf497-3f3b-4fff-a72f-dff16510925f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:13.558791 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babf497-3f3b-4fff-a72f-dff16510925f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:13.619223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c3737-7e91-459b-9fb9-38fb3df4886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:13.619900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3737-7e91-459b-9fb9-38fb3df4886e admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:13.620221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3737-7e91-459b-9fb9-38fb3df4886e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:13.620501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3737-7e91-459b-9fb9-38fb3df4886e admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:13.621203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c3737-7e91-459b-9fb9-38fb3df4886e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:13.624212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c3737-7e91-459b-9fb9-38fb3df4886e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:13.737366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1283/2578] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:13 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:13.741710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb06a-2a01-4f74-8f39-cc20176e83de admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:13.754966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb06a-2a01-4f74-8f39-cc20176e83de admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:13.760019 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffa7a0-b9a2-418c-87e0-c9b68fee9c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:13.760748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffa7a0-b9a2-418c-87e0-c9b68fee9c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:13.761034 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffa7a0-b9a2-418c-87e0-c9b68fee9c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:13.761312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffa7a0-b9a2-418c-87e0-c9b68fee9c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:13.762042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffa7a0-b9a2-418c-87e0-c9b68fee9c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:13.764308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffa7a0-b9a2-418c-87e0-c9b68fee9c59 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:13.777361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1296/2579] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:13.781423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c3737-7e91-459b-9fb9-38fb3df4886e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:13.792195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c3737-7e91-459b-9fb9-38fb3df4886e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:13.797413 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90acec-226d-44b7-b82b-a76bb2f43d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:13.798170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90acec-226d-44b7-b82b-a76bb2f43d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:13.798454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90acec-226d-44b7-b82b-a76bb2f43d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:13.798778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90acec-226d-44b7-b82b-a76bb2f43d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:13.799545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90acec-226d-44b7-b82b-a76bb2f43d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:13.801193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90acec-226d-44b7-b82b-a76bb2f43d1c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:13.817918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1284/2580] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:13.822326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffa7a0-b9a2-418c-87e0-c9b68fee9c59 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:13.834503 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffa7a0-b9a2-418c-87e0-c9b68fee9c59 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:13.840039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f92a73-3ca5-48a9-8931-6e1ccc90139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:13.840981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92a73-3ca5-48a9-8931-6e1ccc90139b admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:13.841263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92a73-3ca5-48a9-8931-6e1ccc90139b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:13.841545 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92a73-3ca5-48a9-8931-6e1ccc90139b admin admin] PATH_INFO: `/v3/projects/53e058fda3d647ceb75a8eaeb3c21303/users/7d0ee7eb6f32494b878016b3a2bbd6aa/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:13.857130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f92a73-3ca5-48a9-8931-6e1ccc90139b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e058fda3d647ceb75a8eaeb3c21303, user_id=7d0ee7eb6f32494b878016b3a2bbd6aa, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:13.861011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f92a73-3ca5-48a9-8931-6e1ccc90139b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:13.959557 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1297/2581] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:13 2022] PUT /identity/v3/projects/53e058fda3d647ceb75a8eaeb3c21303/users/7d0ee7eb6f32494b878016b3a2bbd6aa/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:13.970986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18c59e-2a3e-46af-b407-177fedb8b785 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:13.971276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18c59e-2a3e-46af-b407-177fedb8b785 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:13.971560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18c59e-2a3e-46af-b407-177fedb8b785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:14.001062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8f18c59e-2a3e-46af-b407-177fedb8b785 None None] MFA Rules not processed for user `7d0ee7eb6f32494b878016b3a2bbd6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:14.002353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8f18c59e-2a3e-46af-b407-177fedb8b785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:14.023811 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:14.071897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1285/2582] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:14.076761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f92a73-3ca5-48a9-8931-6e1ccc90139b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:14.143744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f92a73-3ca5-48a9-8931-6e1ccc90139b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:14.148719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a600b-f250-49c6-aa3c-aa4921198abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:14.149394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a600b-f250-49c6-aa3c-aa4921198abe admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:14.149680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a600b-f250-49c6-aa3c-aa4921198abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:14.149985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a600b-f250-49c6-aa3c-aa4921198abe admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:14.150672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a600b-f250-49c6-aa3c-aa4921198abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:14.152754 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a600b-f250-49c6-aa3c-aa4921198abe admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:14.250618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1298/2583] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:14 2022] POST /identity/v3/projects => generated 391 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:14.262326 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18c59e-2a3e-46af-b407-177fedb8b785 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:14.268244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18c59e-2a3e-46af-b407-177fedb8b785 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:14.326081 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbeb7b-7b94-40c7-a08e-3e6d06b46a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:14.326669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbeb7b-7b94-40c7-a08e-3e6d06b46a5c admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:14.326955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbeb7b-7b94-40c7-a08e-3e6d06b46a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:14.327233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbeb7b-7b94-40c7-a08e-3e6d06b46a5c admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:14.327923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbeb7b-7b94-40c7-a08e-3e6d06b46a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:14.329897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbeb7b-7b94-40c7-a08e-3e6d06b46a5c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:14.411889 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1286/2584] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:14 2022] POST /identity/v3/users => generated 302 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:14.415709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a600b-f250-49c6-aa3c-aa4921198abe admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:14.427787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a600b-f250-49c6-aa3c-aa4921198abe admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:14.432734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6698c9-110a-4644-8c8b-df49adaaeabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:14.433445 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6698c9-110a-4644-8c8b-df49adaaeabb admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:14.433730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6698c9-110a-4644-8c8b-df49adaaeabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:14.434008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6698c9-110a-4644-8c8b-df49adaaeabb admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:14.434743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6698c9-110a-4644-8c8b-df49adaaeabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:14.437194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6698c9-110a-4644-8c8b-df49adaaeabb admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:14.448932 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1299/2585] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:14.455946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbeb7b-7b94-40c7-a08e-3e6d06b46a5c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:14.466302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbeb7b-7b94-40c7-a08e-3e6d06b46a5c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:14.471716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4639a-8dc9-422c-8686-0039c88b20f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:14.472682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4639a-8dc9-422c-8686-0039c88b20f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:14.472963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4639a-8dc9-422c-8686-0039c88b20f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:14.473238 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4639a-8dc9-422c-8686-0039c88b20f1 admin admin] PATH_INFO: `/v3/projects/20e279a7792d40c08d29bbbe24b7b55b/users/d50f704fdbe7488787190ee2c894c5e6/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:14.491103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4639a-8dc9-422c-8686-0039c88b20f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e279a7792d40c08d29bbbe24b7b55b, user_id=d50f704fdbe7488787190ee2c894c5e6, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:14.493907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4639a-8dc9-422c-8686-0039c88b20f1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:14.570716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1287/2586] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:14 2022] PUT /identity/v3/projects/20e279a7792d40c08d29bbbe24b7b55b/users/d50f704fdbe7488787190ee2c894c5e6/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:14.575088 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6698c9-110a-4644-8c8b-df49adaaeabb admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:14.587121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6698c9-110a-4644-8c8b-df49adaaeabb admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:14.606449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:14.658186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066be0f-e040-4fbb-9abd-3ad11c77ae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:14.658860 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066be0f-e040-4fbb-9abd-3ad11c77ae04 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:14.659147 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066be0f-e040-4fbb-9abd-3ad11c77ae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:14.659425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066be0f-e040-4fbb-9abd-3ad11c77ae04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:14.660192 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066be0f-e040-4fbb-9abd-3ad11c77ae04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:14.661789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066be0f-e040-4fbb-9abd-3ad11c77ae04 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:14.672361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1300/2587] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:14.676565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4639a-8dc9-422c-8686-0039c88b20f1 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:14.687827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4639a-8dc9-422c-8686-0039c88b20f1 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:14.693242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568e0b5-ad1e-4c6f-ad1a-f852b7befb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:14.694146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568e0b5-ad1e-4c6f-ad1a-f852b7befb46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:14.694428 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568e0b5-ad1e-4c6f-ad1a-f852b7befb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:14.694703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568e0b5-ad1e-4c6f-ad1a-f852b7befb46 admin admin] PATH_INFO: `/v3/projects/20e279a7792d40c08d29bbbe24b7b55b/users/d50f704fdbe7488787190ee2c894c5e6/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:14.696892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568e0b5-ad1e-4c6f-ad1a-f852b7befb46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e279a7792d40c08d29bbbe24b7b55b, user_id=d50f704fdbe7488787190ee2c894c5e6, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:14.699604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568e0b5-ad1e-4c6f-ad1a-f852b7befb46 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:14.711608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1288/2588] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:14 2022] PUT /identity/v3/projects/20e279a7792d40c08d29bbbe24b7b55b/users/d50f704fdbe7488787190ee2c894c5e6/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:14.723279 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b065a60-b8c9-40e3-a5df-b587309f9cef None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:14.723569 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b065a60-b8c9-40e3-a5df-b587309f9cef None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:14.723855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b065a60-b8c9-40e3-a5df-b587309f9cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:14.755793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9b065a60-b8c9-40e3-a5df-b587309f9cef None None] MFA Rules not processed for user `d50f704fdbe7488787190ee2c894c5e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:14.757063 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9b065a60-b8c9-40e3-a5df-b587309f9cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:14.836793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1301/2589] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:14.851498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568e0b5-ad1e-4c6f-ad1a-f852b7befb46 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:14.853387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5568e0b5-ad1e-4c6f-ad1a-f852b7befb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:14.909347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b065a60-b8c9-40e3-a5df-b587309f9cef None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:14.910743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9b065a60-b8c9-40e3-a5df-b587309f9cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:14.916427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568e0b5-ad1e-4c6f-ad1a-f852b7befb46 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:14.920736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007528d-7402-44ce-ac95-a947e52d852b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:14.921395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007528d-7402-44ce-ac95-a947e52d852b service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:14.921682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007528d-7402-44ce-ac95-a947e52d852b service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:14.921958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007528d-7402-44ce-ac95-a947e52d852b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:14.924293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b065a60-b8c9-40e3-a5df-b587309f9cef None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:14.928308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d7170-9015-4c10-9de7-31444948ae93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:14.928976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d7170-9015-4c10-9de7-31444948ae93 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:14.937021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d7170-9015-4c10-9de7-31444948ae93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:14.937021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d7170-9015-4c10-9de7-31444948ae93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:14.937021 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-423d7170-9015-4c10-9de7-31444948ae93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:14.937404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007528d-7402-44ce-ac95-a947e52d852b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:14.937404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007528d-7402-44ce-ac95-a947e52d852b service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:14.951227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1289/2590] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:15.004790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007528d-7402-44ce-ac95-a947e52d852b service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:15.013905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007528d-7402-44ce-ac95-a947e52d852b service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:15.017768 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d7170-9015-4c10-9de7-31444948ae93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:15.017914 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56cf3d-a6d3-4fe3-93f9-7685d69731be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:15.018425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56cf3d-a6d3-4fe3-93f9-7685d69731be service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:15.018709 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56cf3d-a6d3-4fe3-93f9-7685d69731be service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:15.018988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56cf3d-a6d3-4fe3-93f9-7685d69731be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:15.019211 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d7170-9015-4c10-9de7-31444948ae93 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:15.030324 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1302/2591] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:15.037235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:15.092728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56cf3d-a6d3-4fe3-93f9-7685d69731be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:15.092728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56cf3d-a6d3-4fe3-93f9-7685d69731be service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:15.099269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1290/2592] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:20.394349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d7170-9015-4c10-9de7-31444948ae93 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:20.442262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=100 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:20.468166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d7170-9015-4c10-9de7-31444948ae93 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:20.473403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56cf3d-a6d3-4fe3-93f9-7685d69731be service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:20.473918 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:20.474680 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:20.474964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:20.475066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1b56cf3d-a6d3-4fe3-93f9-7685d69731be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:20.475241 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] PATH_INFO: `/v3/users/7d0ee7eb6f32494b878016b3a2bbd6aa` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:20.476499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0ee7eb6f32494b878016b3a2bbd6aa)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:20.478511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:20.489831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56cf3d-a6d3-4fe3-93f9-7685d69731be service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:20.494632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:20.495525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:20.495808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:20.496112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] PATH_INFO: `/v3/users/c6bf8cbf09d0471f948c268c152a25ca` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:20.497335 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bf8cbf09d0471f948c268c152a25ca)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:20.499290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:20.689977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0ee7eb6f32494b878016b3a2bbd6aa'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:20.702700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0ee7eb6f32494b878016b3a2bbd6aa'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:20.737227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bf8cbf09d0471f948c268c152a25ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:20.749377 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bf8cbf09d0471f948c268c152a25ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:20.781245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0ee7eb6f32494b878016b3a2bbd6aa'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:20.782023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0ee7eb6f32494b878016b3a2bbd6aa'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:20.782660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-67fa6ef5-342c-457d-b1fa-d5c43d2910dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0ee7eb6f32494b878016b3a2bbd6aa'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:20.797033 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1303/2593] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:20 2022] DELETE /identity/v3/users/7d0ee7eb6f32494b878016b3a2bbd6aa => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:20.801620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52128-a90c-4f5f-869c-bba64b935ebb None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:20.802028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52128-a90c-4f5f-869c-bba64b935ebb None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:20.802525 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52128-a90c-4f5f-869c-bba64b935ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:20.822987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-12a52128-a90c-4f5f-869c-bba64b935ebb None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:20.824257 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-12a52128-a90c-4f5f-869c-bba64b935ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:20.883988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bf8cbf09d0471f948c268c152a25ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:20.884798 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bf8cbf09d0471f948c268c152a25ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:20.885563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22f48a2e-d748-4604-8e9b-117afff1b85b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bf8cbf09d0471f948c268c152a25ca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:20.888973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1304/2594] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:20.901510 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52128-a90c-4f5f-869c-bba64b935ebb None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:20.902311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1291/2595] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:20 2022] DELETE /identity/v3/users/c6bf8cbf09d0471f948c268c152a25ca => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:20.903802 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-12a52128-a90c-4f5f-869c-bba64b935ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:20.908108 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e8a6-6b95-43cb-b316-38846029544e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:20.908391 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e8a6-6b95-43cb-b316-38846029544e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:20.908668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e8a6-6b95-43cb-b316-38846029544e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:20.933997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0dc0e8a6-6b95-43cb-b316-38846029544e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:20.935527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0dc0e8a6-6b95-43cb-b316-38846029544e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:20.974952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52128-a90c-4f5f-869c-bba64b935ebb None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:20.984185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:21.020881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1292/2596] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:21.020881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0e8a6-6b95-43cb-b316-38846029544e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:21.030745 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ba925-337d-423d-a639-cfda117f5ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:21.032376 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ba925-337d-423d-a639-cfda117f5ebc service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:21.032830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ba925-337d-423d-a639-cfda117f5ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:21.033109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ba925-337d-423d-a639-cfda117f5ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:21.042797 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ba925-337d-423d-a639-cfda117f5ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:21.044277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ba925-337d-423d-a639-cfda117f5ebc service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:21.052193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:21.056353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1305/2597] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:21.077594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0e8a6-6b95-43cb-b316-38846029544e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:21.081357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea0e6-44fe-4b83-b584-2e01e3881429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:21.082021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea0e6-44fe-4b83-b584-2e01e3881429 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:21.082292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea0e6-44fe-4b83-b584-2e01e3881429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:21.082567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea0e6-44fe-4b83-b584-2e01e3881429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:21.092578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea0e6-44fe-4b83-b584-2e01e3881429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:21.094907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea0e6-44fe-4b83-b584-2e01e3881429 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:21.106086 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1293/2598] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:21.686370 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ba925-337d-423d-a639-cfda117f5ebc service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:21.688671 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-315ba925-337d-423d-a639-cfda117f5ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:21.703593 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ba925-337d-423d-a639-cfda117f5ebc service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:21.708596 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:21.709468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:21.709749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:21.710022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] PATH_INFO: `/v3/projects/53e058fda3d647ceb75a8eaeb3c21303` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:21.711281 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e058fda3d647ceb75a8eaeb3c21303)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:21.713300 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:21.731578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea0e6-44fe-4b83-b584-2e01e3881429 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:21.733482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ddfea0e6-44fe-4b83-b584-2e01e3881429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:21.754006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea0e6-44fe-4b83-b584-2e01e3881429 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:21.759725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:21.760178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:21.760755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:21.760755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] PATH_INFO: `/v3/projects/86fd596ae40547798d3810bd6c7ef456` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:21.762158 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fd596ae40547798d3810bd6c7ef456)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:21.764341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:21.857508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e058fda3d647ceb75a8eaeb3c21303', 'request_id': 'req-c9727acc-c9bd-4032-85db-f48fb810e118'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:21.877246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e058fda3d647ceb75a8eaeb3c21303', 'request_id': 'req-c9727acc-c9bd-4032-85db-f48fb810e118'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:21.891059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e058fda3d647ceb75a8eaeb3c21303', 'request_id': 'req-c9727acc-c9bd-4032-85db-f48fb810e118'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:21.901536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fd596ae40547798d3810bd6c7ef456', 'request_id': 'req-e7c1438f-da5c-4c3c-9196-114db8c8a744'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:21.917643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fd596ae40547798d3810bd6c7ef456', 'request_id': 'req-e7c1438f-da5c-4c3c-9196-114db8c8a744'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.003427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] The token cache is being invalidate because project 53e058fda3d647ceb75a8eaeb3c21303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:22.003729 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.004364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.005929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1306/2599] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:21 2022] DELETE /identity/v3/projects/53e058fda3d647ceb75a8eaeb3c21303 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:22.006766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:22.008054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:22.055980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fd596ae40547798d3810bd6c7ef456', 'request_id': 'req-e7c1438f-da5c-4c3c-9196-114db8c8a744'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.068318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9727acc-c9bd-4032-85db-f48fb810e118 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:22.069995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] The token cache is being invalidate because project 86fd596ae40547798d3810bd6c7ef456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:22.070290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.070929 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.072697 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1294/2600] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:21 2022] DELETE /identity/v3/projects/86fd596ae40547798d3810bd6c7ef456 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:22.073383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:22.074673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:22.123968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02f544-8d55-4251-a169-86a5b6629b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:22.125345 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02f544-8d55-4251-a169-86a5b6629b7f service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:22.125850 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02f544-8d55-4251-a169-86a5b6629b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:22.126136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02f544-8d55-4251-a169-86a5b6629b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:22.128036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-df02f544-8d55-4251-a169-86a5b6629b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:22.135818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:22.139999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02f544-8d55-4251-a169-86a5b6629b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:22.141829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02f544-8d55-4251-a169-86a5b6629b7f service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:22.147408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1438f-da5c-4c3c-9196-114db8c8a744 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:22.150335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1307/2601] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:22.151130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02f544-8d55-4251-a169-86a5b6629b7f service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:22.152449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-df02f544-8d55-4251-a169-86a5b6629b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:22.154257 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:22.155443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:22.155689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:22.155996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] PATH_INFO: `/v3/users/d50f704fdbe7488787190ee2c894c5e6` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:22.157344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50f704fdbe7488787190ee2c894c5e6)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:22.159528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:22.169604 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02f544-8d55-4251-a169-86a5b6629b7f service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:22.185941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:22.188940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:22.189234 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:22.189524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] PATH_INFO: `/v3/users/282c1ea5c5274cf1a33497ae35bc7e3d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:22.191062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=282c1ea5c5274cf1a33497ae35bc7e3d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:22.193567 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:22.393955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50f704fdbe7488787190ee2c894c5e6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.401760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:22.411531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50f704fdbe7488787190ee2c894c5e6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.430042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282c1ea5c5274cf1a33497ae35bc7e3d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.444449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282c1ea5c5274cf1a33497ae35bc7e3d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.506676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50f704fdbe7488787190ee2c894c5e6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.507307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50f704fdbe7488787190ee2c894c5e6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.507916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50f704fdbe7488787190ee2c894c5e6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.521279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1295/2602] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:22 2022] DELETE /identity/v3/users/d50f704fdbe7488787190ee2c894c5e6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:22.564925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282c1ea5c5274cf1a33497ae35bc7e3d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.566420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282c1ea5c5274cf1a33497ae35bc7e3d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.567214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282c1ea5c5274cf1a33497ae35bc7e3d'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:22.598563 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1308/2603] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:22 2022] DELETE /identity/v3/users/282c1ea5c5274cf1a33497ae35bc7e3d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:23.090843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:23.091850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:23.170984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e550b1-b3fa-4f23-86b7-245466dd4d2b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:23.195097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:23.196687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:23.238787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:23.239796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:23.240099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:23.240389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] PATH_INFO: `/v3/projects/20e279a7792d40c08d29bbbe24b7b55b` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:23.242122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e279a7792d40c08d29bbbe24b7b55b)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:23.243626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:23.277366 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930932cc-aced-4600-a6b8-56282c743f62 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:23.282993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:23.283889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:23.284205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:23.284485 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] PATH_INFO: `/v3/projects/817f7c7313e04b67813252ab6fc9d212` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:23.285692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=817f7c7313e04b67813252ab6fc9d212)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:23.289019 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:23.367603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e279a7792d40c08d29bbbe24b7b55b', 'request_id': 'req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:23.376190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e279a7792d40c08d29bbbe24b7b55b', 'request_id': 'req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:23.522473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817f7c7313e04b67813252ab6fc9d212', 'request_id': 'req-292be31b-9cde-4336-a490-eeb51cd3ca80'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:23.528058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817f7c7313e04b67813252ab6fc9d212', 'request_id': 'req-292be31b-9cde-4336-a490-eeb51cd3ca80'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:23.534538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817f7c7313e04b67813252ab6fc9d212', 'request_id': 'req-292be31b-9cde-4336-a490-eeb51cd3ca80'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:23.570463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e279a7792d40c08d29bbbe24b7b55b', 'request_id': 'req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:23.583119 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] The token cache is being invalidate because project 20e279a7792d40c08d29bbbe24b7b55b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:23.583407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:23.584059 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c3c0f3d1-37f5-4666-8693-cdcc7b683dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:23.585683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1296/2604] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:23 2022] DELETE /identity/v3/projects/20e279a7792d40c08d29bbbe24b7b55b => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:23.590531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd6854-f9b9-4cfa-aa43-c41e770aeba0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:23.590810 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd6854-f9b9-4cfa-aa43-c41e770aeba0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:23.591092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd6854-f9b9-4cfa-aa43-c41e770aeba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:23.610310 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e9bd6854-f9b9-4cfa-aa43-c41e770aeba0 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:23.611862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e9bd6854-f9b9-4cfa-aa43-c41e770aeba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:23.618190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:23.679671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1297/2605] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:23.690436 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dec2af-eff9-420c-a7e4-2a56a6aadc48 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:23.690780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dec2af-eff9-420c-a7e4-2a56a6aadc48 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:23.691296 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dec2af-eff9-420c-a7e4-2a56a6aadc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:23.711369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f3dec2af-eff9-420c-a7e4-2a56a6aadc48 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:23.712652 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f3dec2af-eff9-420c-a7e4-2a56a6aadc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:23.714188 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:23.721947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1298/2606] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:23.727642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dec2af-eff9-420c-a7e4-2a56a6aadc48 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:23.737695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dec2af-eff9-420c-a7e4-2a56a6aadc48 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:23.737907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] The token cache is being invalidate because project 817f7c7313e04b67813252ab6fc9d212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:23.738199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:23.739077 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-292be31b-9cde-4336-a490-eeb51cd3ca80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:23.741551 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1309/2607] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:23 2022] DELETE /identity/v3/projects/817f7c7313e04b67813252ab6fc9d212 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:23.748570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5808e2-33ec-421c-b149-122d61139c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:23.748570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5808e2-33ec-421c-b149-122d61139c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:23.748570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5808e2-33ec-421c-b149-122d61139c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:23.748570 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5808e2-33ec-421c-b149-122d61139c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:23.749095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5808e2-33ec-421c-b149-122d61139c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:23.749095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5808e2-33ec-421c-b149-122d61139c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:23.749095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5808e2-33ec-421c-b149-122d61139c5f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:23.755419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8a45a-8179-40a6-8ed8-99f4fe708d5b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:23.755741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8a45a-8179-40a6-8ed8-99f4fe708d5b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:23.756242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8a45a-8179-40a6-8ed8-99f4fe708d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:23.761529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1299/2608] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:50:23.766063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5808e2-33ec-421c-b149-122d61139c5f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:23.767861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fd5808e2-33ec-421c-b149-122d61139c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:23.780162 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3fc8a45a-8179-40a6-8ed8-99f4fe708d5b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:23.780162 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3fc8a45a-8179-40a6-8ed8-99f4fe708d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:23.780506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5808e2-33ec-421c-b149-122d61139c5f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:23.785915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4121a9-8ca6-48c4-a722-0a67635fc244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:23.786109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1310/2609] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:23.786915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4121a9-8ca6-48c4-a722-0a67635fc244 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:23.787209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4121a9-8ca6-48c4-a722-0a67635fc244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:23.787491 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4121a9-8ca6-48c4-a722-0a67635fc244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:23.788221 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4121a9-8ca6-48c4-a722-0a67635fc244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:23.790212 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4121a9-8ca6-48c4-a722-0a67635fc244 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:23.794130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96fa95-17a1-4dde-80e8-256351d469e1 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:23.794425 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96fa95-17a1-4dde-80e8-256351d469e1 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:23.794746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96fa95-17a1-4dde-80e8-256351d469e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:23.817191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-1c96fa95-17a1-4dde-80e8-256351d469e1 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:23.818662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-1c96fa95-17a1-4dde-80e8-256351d469e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:23.826690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1311/2610] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:23.830998 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96fa95-17a1-4dde-80e8-256351d469e1 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:23.840886 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96fa95-17a1-4dde-80e8-256351d469e1 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:23.847854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5c042-fa3f-4c6f-948a-8e6008173460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:23.848577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c042-fa3f-4c6f-948a-8e6008173460 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:23.865997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c042-fa3f-4c6f-948a-8e6008173460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:23.865997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c042-fa3f-4c6f-948a-8e6008173460 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:23.865997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5c042-fa3f-4c6f-948a-8e6008173460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:23.865997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5c042-fa3f-4c6f-948a-8e6008173460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:23.865997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5c042-fa3f-4c6f-948a-8e6008173460 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:23.865997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1312/2611] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:50:23.869071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5c042-fa3f-4c6f-948a-8e6008173460 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:23.880403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5c042-fa3f-4c6f-948a-8e6008173460 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:23.885126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83291f55-c063-4701-9f8c-ec8a3e64bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:23.885779 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83291f55-c063-4701-9f8c-ec8a3e64bdda admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:23.886071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83291f55-c063-4701-9f8c-ec8a3e64bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:23.886348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83291f55-c063-4701-9f8c-ec8a3e64bdda admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:23.887121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83291f55-c063-4701-9f8c-ec8a3e64bdda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:23.889071 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83291f55-c063-4701-9f8c-ec8a3e64bdda admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:23.982762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1300/2612] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:23 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:23.987787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4121a9-8ca6-48c4-a722-0a67635fc244 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.020004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1313/2613] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:23 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:24.029254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83291f55-c063-4701-9f8c-ec8a3e64bdda admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.060832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4121a9-8ca6-48c4-a722-0a67635fc244 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.105893 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83291f55-c063-4701-9f8c-ec8a3e64bdda admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.112008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c04fed-21a6-4322-bf47-025372fa3661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.112726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04fed-21a6-4322-bf47-025372fa3661 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.113006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04fed-21a6-4322-bf47-025372fa3661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.113275 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04fed-21a6-4322-bf47-025372fa3661 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.113961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c04fed-21a6-4322-bf47-025372fa3661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.115869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c04fed-21a6-4322-bf47-025372fa3661 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.131505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21efb2-e0b7-4e3f-9057-25f7e920a3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.131505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21efb2-e0b7-4e3f-9057-25f7e920a3fb admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.131505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21efb2-e0b7-4e3f-9057-25f7e920a3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.135095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21efb2-e0b7-4e3f-9057-25f7e920a3fb admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.135095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21efb2-e0b7-4e3f-9057-25f7e920a3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.135095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21efb2-e0b7-4e3f-9057-25f7e920a3fb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.244852 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1314/2614] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:24 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:24.248900 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c04fed-21a6-4322-bf47-025372fa3661 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.260404 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c04fed-21a6-4322-bf47-025372fa3661 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.260587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1301/2615] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:23 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:24.263569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21efb2-e0b7-4e3f-9057-25f7e920a3fb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.266165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ebdcc-88a2-4a36-b01f-8698aae4a763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.266953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ebdcc-88a2-4a36-b01f-8698aae4a763 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.267318 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ebdcc-88a2-4a36-b01f-8698aae4a763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.267668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ebdcc-88a2-4a36-b01f-8698aae4a763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.268528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ebdcc-88a2-4a36-b01f-8698aae4a763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.270275 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ebdcc-88a2-4a36-b01f-8698aae4a763 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.275976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21efb2-e0b7-4e3f-9057-25f7e920a3fb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.282630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1315/2616] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:24.286449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ebdcc-88a2-4a36-b01f-8698aae4a763 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.287209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c2619-f005-4e8d-8ae3-6f4fc0e8614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.287978 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c2619-f005-4e8d-8ae3-6f4fc0e8614a admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.288367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c2619-f005-4e8d-8ae3-6f4fc0e8614a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.288713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c2619-f005-4e8d-8ae3-6f4fc0e8614a admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.289597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c2619-f005-4e8d-8ae3-6f4fc0e8614a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.291235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c2619-f005-4e8d-8ae3-6f4fc0e8614a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.297822 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ebdcc-88a2-4a36-b01f-8698aae4a763 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.304799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307fcb1-f8a8-484c-b9af-ce93fd7a5a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.305777 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fcb1-f8a8-484c-b9af-ce93fd7a5a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.306261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1302/2617] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:24.307307 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fcb1-f8a8-484c-b9af-ce93fd7a5a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.309187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fcb1-f8a8-484c-b9af-ce93fd7a5a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.309187 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307fcb1-f8a8-484c-b9af-ce93fd7a5a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.310160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307fcb1-f8a8-484c-b9af-ce93fd7a5a08 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.312731 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c2619-f005-4e8d-8ae3-6f4fc0e8614a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.324722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1316/2618] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:24.328878 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c2619-f005-4e8d-8ae3-6f4fc0e8614a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.330057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307fcb1-f8a8-484c-b9af-ce93fd7a5a08 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.332508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce759711-ea79-498d-b020-c7c5dc9c8144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.332796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce759711-ea79-498d-b020-c7c5dc9c8144 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.333092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce759711-ea79-498d-b020-c7c5dc9c8144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.333372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce759711-ea79-498d-b020-c7c5dc9c8144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.334473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce759711-ea79-498d-b020-c7c5dc9c8144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.336342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce759711-ea79-498d-b020-c7c5dc9c8144 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.339265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:24.343093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307fcb1-f8a8-484c-b9af-ce93fd7a5a08 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.349988 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc424dbc-94eb-4aba-884c-28abf97cba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.350951 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424dbc-94eb-4aba-884c-28abf97cba23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.351235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424dbc-94eb-4aba-884c-28abf97cba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.351376 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1303/2619] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:24.351514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424dbc-94eb-4aba-884c-28abf97cba23 admin admin] PATH_INFO: `/v3/projects/a502d4c9da8040a7bc22dfd53cb1c217/users/cd0d6c3d2e4a4d03ae0f83825e57ba61/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.356007 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce759711-ea79-498d-b020-c7c5dc9c8144 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.367176 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce759711-ea79-498d-b020-c7c5dc9c8144 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.367664 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc424dbc-94eb-4aba-884c-28abf97cba23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a502d4c9da8040a7bc22dfd53cb1c217, user_id=cd0d6c3d2e4a4d03ae0f83825e57ba61, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.370837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc424dbc-94eb-4aba-884c-28abf97cba23 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.372271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd72c38-2a44-463d-98e5-6c6ec9e5539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.373209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72c38-2a44-463d-98e5-6c6ec9e5539b admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.373488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72c38-2a44-463d-98e5-6c6ec9e5539b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.373762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72c38-2a44-463d-98e5-6c6ec9e5539b admin admin] PATH_INFO: `/v3/projects/8af958f091b848a0b94cbbf695ba2a4e/users/d47028686a1245258d117b277257fcc4/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.392101 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd72c38-2a44-463d-98e5-6c6ec9e5539b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af958f091b848a0b94cbbf695ba2a4e, user_id=d47028686a1245258d117b277257fcc4, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.394776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd72c38-2a44-463d-98e5-6c6ec9e5539b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.475971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1317/2620] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:24 2022] PUT /identity/v3/projects/a502d4c9da8040a7bc22dfd53cb1c217/users/cd0d6c3d2e4a4d03ae0f83825e57ba61/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:24.487238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3684fb-a3cc-4ae7-ad69-7bb1afd505c8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.487528 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3684fb-a3cc-4ae7-ad69-7bb1afd505c8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.487809 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3684fb-a3cc-4ae7-ad69-7bb1afd505c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.491651 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1304/2621] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:24 2022] PUT /identity/v3/projects/8af958f091b848a0b94cbbf695ba2a4e/users/d47028686a1245258d117b277257fcc4/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:24.502316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20f142-8ff4-4372-aea9-a9e1d0d53e90 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.502610 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20f142-8ff4-4372-aea9-a9e1d0d53e90 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.502891 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20f142-8ff4-4372-aea9-a9e1d0d53e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.518941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6d3684fb-a3cc-4ae7-ad69-7bb1afd505c8 None None] MFA Rules not processed for user `cd0d6c3d2e4a4d03ae0f83825e57ba61`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:24.520243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6d3684fb-a3cc-4ae7-ad69-7bb1afd505c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:24.531502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fb20f142-8ff4-4372-aea9-a9e1d0d53e90 None None] MFA Rules not processed for user `d47028686a1245258d117b277257fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:24.532777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fb20f142-8ff4-4372-aea9-a9e1d0d53e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:24.574625 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:24.600378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1318/2622] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:24.605036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3684fb-a3cc-4ae7-ad69-7bb1afd505c8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.612133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1305/2623] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:24.624468 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20f142-8ff4-4372-aea9-a9e1d0d53e90 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.626066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fb20f142-8ff4-4372-aea9-a9e1d0d53e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:24.674089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3684fb-a3cc-4ae7-ad69-7bb1afd505c8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.679218 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe69d6-b824-4633-8569-d7a12ee29291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.679894 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe69d6-b824-4633-8569-d7a12ee29291 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.680229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe69d6-b824-4633-8569-d7a12ee29291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.680512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe69d6-b824-4633-8569-d7a12ee29291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.681201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe69d6-b824-4633-8569-d7a12ee29291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.683111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe69d6-b824-4633-8569-d7a12ee29291 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.687602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20f142-8ff4-4372-aea9-a9e1d0d53e90 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.692047 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e72c5e-d41e-4bde-b9c3-c36a9ddb764a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.693461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e72c5e-d41e-4bde-b9c3-c36a9ddb764a service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.693746 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e72c5e-d41e-4bde-b9c3-c36a9ddb764a service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.694025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e72c5e-d41e-4bde-b9c3-c36a9ddb764a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.705935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e72c5e-d41e-4bde-b9c3-c36a9ddb764a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.707424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e72c5e-d41e-4bde-b9c3-c36a9ddb764a service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.717041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1306/2624] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:24.736259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e72c5e-d41e-4bde-b9c3-c36a9ddb764a service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.747211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e72c5e-d41e-4bde-b9c3-c36a9ddb764a service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.752975 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.753869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.754254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.754537 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] PATH_INFO: `/v3/users/d47028686a1245258d117b277257fcc4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.755897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d47028686a1245258d117b277257fcc4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.757991 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.788033 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1319/2625] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:24 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:24.792132 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe69d6-b824-4633-8569-d7a12ee29291 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.865011 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe69d6-b824-4633-8569-d7a12ee29291 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:24.869958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331bf05-57ef-4d9d-b18f-fe24c9f7c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:24.870641 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331bf05-57ef-4d9d-b18f-fe24c9f7c290 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:24.870927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331bf05-57ef-4d9d-b18f-fe24c9f7c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:24.871204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331bf05-57ef-4d9d-b18f-fe24c9f7c290 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:24.871897 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331bf05-57ef-4d9d-b18f-fe24c9f7c290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:24.873878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331bf05-57ef-4d9d-b18f-fe24c9f7c290 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:24.960184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd47028686a1245258d117b277257fcc4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:24.961334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:24.973402 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd47028686a1245258d117b277257fcc4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:24.980039 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1320/2626] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:24 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:24.984018 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331bf05-57ef-4d9d-b18f-fe24c9f7c290 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:24.995275 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331bf05-57ef-4d9d-b18f-fe24c9f7c290 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:25.001656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d554d-0a89-4c33-8fa1-0c93c52405d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:25.002342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d554d-0a89-4c33-8fa1-0c93c52405d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:25.002631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d554d-0a89-4c33-8fa1-0c93c52405d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:25.002914 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d554d-0a89-4c33-8fa1-0c93c52405d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:25.003651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d554d-0a89-4c33-8fa1-0c93c52405d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:25.005311 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d554d-0a89-4c33-8fa1-0c93c52405d1 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:25.017284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1321/2627] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:25.022999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d554d-0a89-4c33-8fa1-0c93c52405d1 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:25.033977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d554d-0a89-4c33-8fa1-0c93c52405d1 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:25.038939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df870380-f048-4aa3-a05d-69e78bde7e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:25.039888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df870380-f048-4aa3-a05d-69e78bde7e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:25.040216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df870380-f048-4aa3-a05d-69e78bde7e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:25.049878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df870380-f048-4aa3-a05d-69e78bde7e28 admin admin] PATH_INFO: `/v3/projects/c7336efcf792489aa40f998928863804/users/1d25fc165e0a4ca180f50603af27db26/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:25.056876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df870380-f048-4aa3-a05d-69e78bde7e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7336efcf792489aa40f998928863804, user_id=1d25fc165e0a4ca180f50603af27db26, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:25.059509 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df870380-f048-4aa3-a05d-69e78bde7e28 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:25.076261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd47028686a1245258d117b277257fcc4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:25.076907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd47028686a1245258d117b277257fcc4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:25.077560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d91e92cb-fa8d-4f9c-8dfe-7ee2dfbc042d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd47028686a1245258d117b277257fcc4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:25.090607 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1307/2628] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:24 2022] DELETE /identity/v3/users/d47028686a1245258d117b277257fcc4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:25.095280 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be0256-7c35-4434-9d9c-bd297645162f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:25.095571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be0256-7c35-4434-9d9c-bd297645162f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:25.095846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be0256-7c35-4434-9d9c-bd297645162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:25.115478 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a0be0256-7c35-4434-9d9c-bd297645162f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:25.116670 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a0be0256-7c35-4434-9d9c-bd297645162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:25.157097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1322/2629] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:25 2022] PUT /identity/v3/projects/c7336efcf792489aa40f998928863804/users/1d25fc165e0a4ca180f50603af27db26/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:25.161029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df870380-f048-4aa3-a05d-69e78bde7e28 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:25.162760 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-df870380-f048-4aa3-a05d-69e78bde7e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:25.183343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1308/2630] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:25.191090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:25.195105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be0256-7c35-4434-9d9c-bd297645162f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:25.196603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a0be0256-7c35-4434-9d9c-bd297645162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:25.233631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df870380-f048-4aa3-a05d-69e78bde7e28 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:25.240349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a0639-28b6-484f-acc3-a05ffa247b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:25.241112 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a0639-28b6-484f-acc3-a05ffa247b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:25.241454 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a0639-28b6-484f-acc3-a05ffa247b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:25.241821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a0639-28b6-484f-acc3-a05ffa247b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:25.242589 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a0639-28b6-484f-acc3-a05ffa247b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:25.252053 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a0639-28b6-484f-acc3-a05ffa247b63 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:25.256913 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1323/2631] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:25.261209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a0639-28b6-484f-acc3-a05ffa247b63 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:25.266809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be0256-7c35-4434-9d9c-bd297645162f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:25.272751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a0639-28b6-484f-acc3-a05ffa247b63 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:25.279111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d04f1c-ca32-4f2c-b877-7a5520f14b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:25.280289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d04f1c-ca32-4f2c-b877-7a5520f14b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:25.280451 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d04f1c-ca32-4f2c-b877-7a5520f14b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:25.280780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d04f1c-ca32-4f2c-b877-7a5520f14b94 admin admin] PATH_INFO: `/v3/projects/c7336efcf792489aa40f998928863804/users/1d25fc165e0a4ca180f50603af27db26/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:25.284472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d04f1c-ca32-4f2c-b877-7a5520f14b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7336efcf792489aa40f998928863804, user_id=1d25fc165e0a4ca180f50603af27db26, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:25.287093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d04f1c-ca32-4f2c-b877-7a5520f14b94 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:25.300741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1324/2632] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:25 2022] PUT /identity/v3/projects/c7336efcf792489aa40f998928863804/users/1d25fc165e0a4ca180f50603af27db26/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:25.311529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f321-0db3-4f8f-94e1-a5987b4c9f38 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:25.311824 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f321-0db3-4f8f-94e1-a5987b4c9f38 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:25.312926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f321-0db3-4f8f-94e1-a5987b4c9f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:25.342972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311747-3042-4487-adcd-42b203c5a5e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:25.343825 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311747-3042-4487-adcd-42b203c5a5e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:25.344331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311747-3042-4487-adcd-42b203c5a5e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:25.345125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311747-3042-4487-adcd-42b203c5a5e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:25.347796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-16d8f321-0db3-4f8f-94e1-a5987b4c9f38 None None] MFA Rules not processed for user `1d25fc165e0a4ca180f50603af27db26`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:25.349076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-16d8f321-0db3-4f8f-94e1-a5987b4c9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:25.356138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87311747-3042-4487-adcd-42b203c5a5e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:25.357604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87311747-3042-4487-adcd-42b203c5a5e0 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:25.370159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1309/2633] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:25.433580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1325/2634] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:25.445485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311747-3042-4487-adcd-42b203c5a5e0 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:25.448752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-87311747-3042-4487-adcd-42b203c5a5e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:25.482109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:25.513039 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311747-3042-4487-adcd-42b203c5a5e0 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:25.565203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19edd9-4ae7-4380-9e2e-c69f8e8a620b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:25.565868 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19edd9-4ae7-4380-9e2e-c69f8e8a620b service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:25.566215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19edd9-4ae7-4380-9e2e-c69f8e8a620b service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:25.566489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19edd9-4ae7-4380-9e2e-c69f8e8a620b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:25.576411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19edd9-4ae7-4380-9e2e-c69f8e8a620b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:25.578099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19edd9-4ae7-4380-9e2e-c69f8e8a620b service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:25.588468 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1310/2635] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:25.696056 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8f321-0db3-4f8f-94e1-a5987b4c9f38 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:25.706975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8f321-0db3-4f8f-94e1-a5987b4c9f38 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:25.710670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6da83-b9b6-406a-b8b1-94f38eb9c994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:25.711377 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6da83-b9b6-406a-b8b1-94f38eb9c994 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:25.711727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6da83-b9b6-406a-b8b1-94f38eb9c994 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:25.712015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6da83-b9b6-406a-b8b1-94f38eb9c994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:25.714003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-eeb6da83-b9b6-406a-b8b1-94f38eb9c994 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:25.784763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6da83-b9b6-406a-b8b1-94f38eb9c994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:25.786267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6da83-b9b6-406a-b8b1-94f38eb9c994 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:25.796135 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1326/2636] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:25.903161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19edd9-4ae7-4380-9e2e-c69f8e8a620b service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:25.904778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2b19edd9-4ae7-4380-9e2e-c69f8e8a620b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:25.996574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19edd9-4ae7-4380-9e2e-c69f8e8a620b service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:26.002584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:26.003452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:26.003732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:26.004005 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] PATH_INFO: `/v3/projects/8af958f091b848a0b94cbbf695ba2a4e` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:26.005215 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af958f091b848a0b94cbbf695ba2a4e)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:26.007185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:26.120348 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af958f091b848a0b94cbbf695ba2a4e', 'request_id': 'req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:26.126882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af958f091b848a0b94cbbf695ba2a4e', 'request_id': 'req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:26.249627 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af958f091b848a0b94cbbf695ba2a4e', 'request_id': 'req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:26.261713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] The token cache is being invalidate because project 8af958f091b848a0b94cbbf695ba2a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:26.262002 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:26.262668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5cee6c99-a119-4ac7-98db-1cb0fe913aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:26.264234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1311/2637] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:25 2022] DELETE /identity/v3/projects/8af958f091b848a0b94cbbf695ba2a4e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:26.269141 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad61d-d7ae-4ead-8538-8987d5810e18 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:26.269623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad61d-d7ae-4ead-8538-8987d5810e18 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:26.269747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad61d-d7ae-4ead-8538-8987d5810e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:26.289216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-927ad61d-d7ae-4ead-8538-8987d5810e18 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:26.290461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-927ad61d-d7ae-4ead-8538-8987d5810e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:26.317075 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:26.352867 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1327/2638] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:26.362703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9057-0ee3-482d-8ff5-563122d01c9f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:26.363077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9057-0ee3-482d-8ff5-563122d01c9f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:26.363356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9057-0ee3-482d-8ff5-563122d01c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:26.382188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-80af9057-0ee3-482d-8ff5-563122d01c9f None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:26.383392 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-80af9057-0ee3-482d-8ff5-563122d01c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:26.391848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1312/2639] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:26.396847 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ad61d-d7ae-4ead-8538-8987d5810e18 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:26.406640 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ad61d-d7ae-4ead-8538-8987d5810e18 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:26.411326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67404130-e44f-4429-a83a-59c78b7afce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:26.411990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67404130-e44f-4429-a83a-59c78b7afce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:26.412315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67404130-e44f-4429-a83a-59c78b7afce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:26.412599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67404130-e44f-4429-a83a-59c78b7afce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:26.413322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67404130-e44f-4429-a83a-59c78b7afce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:26.413637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67404130-e44f-4429-a83a-59c78b7afce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:26.415244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67404130-e44f-4429-a83a-59c78b7afce9 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:26.429363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1328/2640] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:50:26.433553 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af9057-0ee3-482d-8ff5-563122d01c9f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:26.443541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af9057-0ee3-482d-8ff5-563122d01c9f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:26.448191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de6b17-2bc4-47d8-a49b-3aef7cdbd2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:26.448951 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de6b17-2bc4-47d8-a49b-3aef7cdbd2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:26.449230 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de6b17-2bc4-47d8-a49b-3aef7cdbd2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:26.449501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de6b17-2bc4-47d8-a49b-3aef7cdbd2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:26.450172 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de6b17-2bc4-47d8-a49b-3aef7cdbd2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:26.452033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de6b17-2bc4-47d8-a49b-3aef7cdbd2c0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:26.456042 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:26.583227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1313/2641] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:26 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:26.589144 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67404130-e44f-4429-a83a-59c78b7afce9 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:26.598036 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67404130-e44f-4429-a83a-59c78b7afce9 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:26.668053 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67feee-2e23-431b-9981-f92cf80ab4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:26.669037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67feee-2e23-431b-9981-f92cf80ab4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:26.669413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67feee-2e23-431b-9981-f92cf80ab4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:26.669578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67feee-2e23-431b-9981-f92cf80ab4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:26.670266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67feee-2e23-431b-9981-f92cf80ab4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:26.673044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67feee-2e23-431b-9981-f92cf80ab4a9 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:26.780388 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1329/2642] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:26 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:26.784667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de6b17-2bc4-47d8-a49b-3aef7cdbd2c0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:26.795144 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de6b17-2bc4-47d8-a49b-3aef7cdbd2c0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:26.801384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea99684-ac21-4b62-bf95-e91dd57a81cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:26.802103 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea99684-ac21-4b62-bf95-e91dd57a81cd admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:26.802386 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea99684-ac21-4b62-bf95-e91dd57a81cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:26.802658 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea99684-ac21-4b62-bf95-e91dd57a81cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:26.803383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea99684-ac21-4b62-bf95-e91dd57a81cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:26.805049 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea99684-ac21-4b62-bf95-e91dd57a81cd admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:26.816736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1314/2643] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:26.821109 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67feee-2e23-431b-9981-f92cf80ab4a9 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:26.831624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67feee-2e23-431b-9981-f92cf80ab4a9 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:26.837559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26a389-3d78-494f-9c5f-06818cc6e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:26.837559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26a389-3d78-494f-9c5f-06818cc6e378 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:26.837559 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26a389-3d78-494f-9c5f-06818cc6e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:26.837884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26a389-3d78-494f-9c5f-06818cc6e378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:26.838564 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26a389-3d78-494f-9c5f-06818cc6e378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:26.840183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26a389-3d78-494f-9c5f-06818cc6e378 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:26.851971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1330/2644] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:26.856495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea99684-ac21-4b62-bf95-e91dd57a81cd admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:26.868105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea99684-ac21-4b62-bf95-e91dd57a81cd admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:26.872768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33afde2-de68-4972-8e11-9cf3e0f1f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:26.873688 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33afde2-de68-4972-8e11-9cf3e0f1f2db admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:26.873970 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33afde2-de68-4972-8e11-9cf3e0f1f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:26.874249 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33afde2-de68-4972-8e11-9cf3e0f1f2db admin admin] PATH_INFO: `/v3/projects/78acab55526048f68f47e562519b1a17/users/da4ae20e09f24acd8797806a817203dd/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:26.891568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33afde2-de68-4972-8e11-9cf3e0f1f2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=78acab55526048f68f47e562519b1a17, user_id=da4ae20e09f24acd8797806a817203dd, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:26.894353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33afde2-de68-4972-8e11-9cf3e0f1f2db admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:26.998758 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1315/2645] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:26 2022] PUT /identity/v3/projects/78acab55526048f68f47e562519b1a17/users/da4ae20e09f24acd8797806a817203dd/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:27.010508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f28540-3dae-4d97-b5d8-7bbed61c30f8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:27.010712 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f28540-3dae-4d97-b5d8-7bbed61c30f8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:27.010993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f28540-3dae-4d97-b5d8-7bbed61c30f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:27.040707 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-77f28540-3dae-4d97-b5d8-7bbed61c30f8 None None] MFA Rules not processed for user `da4ae20e09f24acd8797806a817203dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:27.041937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-77f28540-3dae-4d97-b5d8-7bbed61c30f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:27.109446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1331/2646] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:27.114678 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33afde2-de68-4972-8e11-9cf3e0f1f2db admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:27.180589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33afde2-de68-4972-8e11-9cf3e0f1f2db admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:27.185383 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4321e8-e8db-4157-9851-768bcbd69170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:27.186053 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4321e8-e8db-4157-9851-768bcbd69170 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:27.186340 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4321e8-e8db-4157-9851-768bcbd69170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:27.186621 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4321e8-e8db-4157-9851-768bcbd69170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:27.187566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4321e8-e8db-4157-9851-768bcbd69170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:27.189616 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4321e8-e8db-4157-9851-768bcbd69170 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:27.280283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1316/2647] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:27 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:27.284762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f28540-3dae-4d97-b5d8-7bbed61c30f8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:27.295885 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f28540-3dae-4d97-b5d8-7bbed61c30f8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:27.317829 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:27.358358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e826f98-b24e-4943-8d7d-ec76df4e44b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:27.359185 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e826f98-b24e-4943-8d7d-ec76df4e44b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:27.359469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e826f98-b24e-4943-8d7d-ec76df4e44b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:27.359748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e826f98-b24e-4943-8d7d-ec76df4e44b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:27.360470 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e826f98-b24e-4943-8d7d-ec76df4e44b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:27.362387 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e826f98-b24e-4943-8d7d-ec76df4e44b8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:27.433260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1332/2648] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:27 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:27.437399 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4321e8-e8db-4157-9851-768bcbd69170 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:27.448845 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4321e8-e8db-4157-9851-768bcbd69170 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:27.454594 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff1b76-da66-4df2-b80c-9ef2f7c1e55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:27.455273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff1b76-da66-4df2-b80c-9ef2f7c1e55d admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:27.455561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff1b76-da66-4df2-b80c-9ef2f7c1e55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:27.455839 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff1b76-da66-4df2-b80c-9ef2f7c1e55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:27.456613 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff1b76-da66-4df2-b80c-9ef2f7c1e55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:27.458209 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff1b76-da66-4df2-b80c-9ef2f7c1e55d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:27.471606 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1317/2649] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:27.476024 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e826f98-b24e-4943-8d7d-ec76df4e44b8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:27.487246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e826f98-b24e-4943-8d7d-ec76df4e44b8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:27.493610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e091fe-215f-405e-acc9-161131903241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:27.494305 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e091fe-215f-405e-acc9-161131903241 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:27.494575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e091fe-215f-405e-acc9-161131903241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:27.494855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e091fe-215f-405e-acc9-161131903241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:27.495590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e091fe-215f-405e-acc9-161131903241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:27.497233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e091fe-215f-405e-acc9-161131903241 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:27.508499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1333/2650] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:27.513637 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff1b76-da66-4df2-b80c-9ef2f7c1e55d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:27.525134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff1b76-da66-4df2-b80c-9ef2f7c1e55d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:27.529935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89147-617d-42f3-97ca-4132a4b7f0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:27.531814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89147-617d-42f3-97ca-4132a4b7f0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:27.532034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89147-617d-42f3-97ca-4132a4b7f0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:27.532358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89147-617d-42f3-97ca-4132a4b7f0ae admin admin] PATH_INFO: `/v3/projects/0f1b7cbf5f38454998f193d58e2aa06c/users/ad3e7ecad5884cf0917deb62ac0d4cc2/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:27.548831 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c89147-617d-42f3-97ca-4132a4b7f0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1b7cbf5f38454998f193d58e2aa06c, user_id=ad3e7ecad5884cf0917deb62ac0d4cc2, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:27.551539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c89147-617d-42f3-97ca-4132a4b7f0ae admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:27.650446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1318/2651] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:27 2022] PUT /identity/v3/projects/0f1b7cbf5f38454998f193d58e2aa06c/users/ad3e7ecad5884cf0917deb62ac0d4cc2/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:27.662023 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d60b26-8f1a-47b7-a29e-5a5fbee937cd None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:27.662319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d60b26-8f1a-47b7-a29e-5a5fbee937cd None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:27.662602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d60b26-8f1a-47b7-a29e-5a5fbee937cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:27.690844 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d3d60b26-8f1a-47b7-a29e-5a5fbee937cd None None] MFA Rules not processed for user `ad3e7ecad5884cf0917deb62ac0d4cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:27.692341 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d3d60b26-8f1a-47b7-a29e-5a5fbee937cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:27.766950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1334/2652] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:27.777990 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89147-617d-42f3-97ca-4132a4b7f0ae admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:27.856905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89147-617d-42f3-97ca-4132a4b7f0ae admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:27.862777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccafb4e-fb82-477b-a4d3-bd0cd1b4289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:27.863458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccafb4e-fb82-477b-a4d3-bd0cd1b4289c admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:27.863746 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccafb4e-fb82-477b-a4d3-bd0cd1b4289c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:27.864028 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccafb4e-fb82-477b-a4d3-bd0cd1b4289c admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:27.864759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccafb4e-fb82-477b-a4d3-bd0cd1b4289c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:27.866803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccafb4e-fb82-477b-a4d3-bd0cd1b4289c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:27.875170 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:28.029580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1319/2653] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:27 2022] POST /identity/v3/projects => generated 377 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:28.035085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d60b26-8f1a-47b7-a29e-5a5fbee937cd None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:28.046012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d60b26-8f1a-47b7-a29e-5a5fbee937cd None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:28.111928 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c10e-3979-4c8c-9e01-1fa9f6786750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:28.112648 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c10e-3979-4c8c-9e01-1fa9f6786750 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:28.112929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c10e-3979-4c8c-9e01-1fa9f6786750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:28.113202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c10e-3979-4c8c-9e01-1fa9f6786750 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:28.113899 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078c10e-3979-4c8c-9e01-1fa9f6786750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:28.115889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078c10e-3979-4c8c-9e01-1fa9f6786750 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:28.228571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1335/2654] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:28 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:28.232549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccafb4e-fb82-477b-a4d3-bd0cd1b4289c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:28.244514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccafb4e-fb82-477b-a4d3-bd0cd1b4289c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:28.249069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a90c4b-20c3-4d6d-b802-942b72b24e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:28.254087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a90c4b-20c3-4d6d-b802-942b72b24e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:28.254087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a90c4b-20c3-4d6d-b802-942b72b24e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:28.254087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a90c4b-20c3-4d6d-b802-942b72b24e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:28.254087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a90c4b-20c3-4d6d-b802-942b72b24e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:28.254087 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a90c4b-20c3-4d6d-b802-942b72b24e46 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:28.266206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1320/2655] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:28.270434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c10e-3979-4c8c-9e01-1fa9f6786750 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:28.281466 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c10e-3979-4c8c-9e01-1fa9f6786750 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:28.286080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b25b6-b8a4-4788-b357-52dfaa1a3ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:28.286915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b25b6-b8a4-4788-b357-52dfaa1a3ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:28.287200 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b25b6-b8a4-4788-b357-52dfaa1a3ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:28.287474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b25b6-b8a4-4788-b357-52dfaa1a3ab9 admin admin] PATH_INFO: `/v3/projects/de8436721234452599f000b0194f9720/users/9b5909b0cbf94fe187e2724c55c0a038/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:28.305619 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b25b6-b8a4-4788-b357-52dfaa1a3ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8436721234452599f000b0194f9720, user_id=9b5909b0cbf94fe187e2724c55c0a038, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:28.308280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b25b6-b8a4-4788-b357-52dfaa1a3ab9 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:28.375611 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:28.381465 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1336/2656] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:28 2022] PUT /identity/v3/projects/de8436721234452599f000b0194f9720/users/9b5909b0cbf94fe187e2724c55c0a038/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:28.385443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a90c4b-20c3-4d6d-b802-942b72b24e46 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:28.404493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a90c4b-20c3-4d6d-b802-942b72b24e46 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:28.464814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70534d87-09aa-4d9d-bca6-7c8094e3bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:28.465520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70534d87-09aa-4d9d-bca6-7c8094e3bbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:28.465857 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70534d87-09aa-4d9d-bca6-7c8094e3bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:28.466184 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70534d87-09aa-4d9d-bca6-7c8094e3bbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:28.466916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70534d87-09aa-4d9d-bca6-7c8094e3bbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:28.469700 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70534d87-09aa-4d9d-bca6-7c8094e3bbc1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:28.480808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1321/2657] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:28.485581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b25b6-b8a4-4788-b357-52dfaa1a3ab9 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:28.496577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b25b6-b8a4-4788-b357-52dfaa1a3ab9 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:28.501362 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c19ffb-c65c-4c03-8e8a-b9ffba330d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:28.502252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c19ffb-c65c-4c03-8e8a-b9ffba330d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:28.502533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c19ffb-c65c-4c03-8e8a-b9ffba330d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:28.502805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c19ffb-c65c-4c03-8e8a-b9ffba330d13 admin admin] PATH_INFO: `/v3/projects/de8436721234452599f000b0194f9720/users/9b5909b0cbf94fe187e2724c55c0a038/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:28.504866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c19ffb-c65c-4c03-8e8a-b9ffba330d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8436721234452599f000b0194f9720, user_id=9b5909b0cbf94fe187e2724c55c0a038, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:28.507472 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c19ffb-c65c-4c03-8e8a-b9ffba330d13 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:28.521206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1337/2658] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:28 2022] PUT /identity/v3/projects/de8436721234452599f000b0194f9720/users/9b5909b0cbf94fe187e2724c55c0a038/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:28.534793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e7e2c-163b-48db-8af5-710d81c7cea4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:28.535082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e7e2c-163b-48db-8af5-710d81c7cea4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:28.535356 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e7e2c-163b-48db-8af5-710d81c7cea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:28.563657 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b01e7e2c-163b-48db-8af5-710d81c7cea4 None None] MFA Rules not processed for user `9b5909b0cbf94fe187e2724c55c0a038`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:28.564897 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b01e7e2c-163b-48db-8af5-710d81c7cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:28.651977 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1322/2659] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:28.665000 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c19ffb-c65c-4c03-8e8a-b9ffba330d13 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:28.667507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d8c19ffb-c65c-4c03-8e8a-b9ffba330d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:28.730053 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c19ffb-c65c-4c03-8e8a-b9ffba330d13 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:28.734875 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b650f-1579-40ca-9f54-aeef46885258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:28.735291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b650f-1579-40ca-9f54-aeef46885258 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:28.735570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b650f-1579-40ca-9f54-aeef46885258 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:28.735846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b650f-1579-40ca-9f54-aeef46885258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:28.801214 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b650f-1579-40ca-9f54-aeef46885258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:28.802765 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b650f-1579-40ca-9f54-aeef46885258 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:28.813776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1338/2660] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:29.183345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e7e2c-163b-48db-8af5-710d81c7cea4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:29.184896 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b01e7e2c-163b-48db-8af5-710d81c7cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:29.251182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:29.257030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e7e2c-163b-48db-8af5-710d81c7cea4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:29.261961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:29.262855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:29.263157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:29.263437 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] PATH_INFO: `/v3/users/cd0d6c3d2e4a4d03ae0f83825e57ba61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:29.265082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0d6c3d2e4a4d03ae0f83825e57ba61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:29.267347 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:29.471987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0d6c3d2e4a4d03ae0f83825e57ba61'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:29.485448 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0d6c3d2e4a4d03ae0f83825e57ba61'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:29.569359 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0d6c3d2e4a4d03ae0f83825e57ba61'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:29.569989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0d6c3d2e4a4d03ae0f83825e57ba61'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:29.570599 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0d6c3d2e4a4d03ae0f83825e57ba61'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:29.585355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1323/2661] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:29 2022] DELETE /identity/v3/users/cd0d6c3d2e4a4d03ae0f83825e57ba61 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:29.589859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1314-ceb4-43ff-aaf8-b52bafad3921 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:29.590336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1314-ceb4-43ff-aaf8-b52bafad3921 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:29.590542 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1314-ceb4-43ff-aaf8-b52bafad3921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:29.608331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-64ae1314-ceb4-43ff-aaf8-b52bafad3921 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:29.610802 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-64ae1314-ceb4-43ff-aaf8-b52bafad3921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:29.688167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1339/2662] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:29.698737 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:29.700543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:29.766676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d3f2b-6fe2-4e59-9658-f2aecf820e69 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:29.772584 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bb60a-04f9-40e1-b355-7922b58a5bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:29.784345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bb60a-04f9-40e1-b355-7922b58a5bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:29.784345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bb60a-04f9-40e1-b355-7922b58a5bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:29.784345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bb60a-04f9-40e1-b355-7922b58a5bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:29.785683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bb60a-04f9-40e1-b355-7922b58a5bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:29.787178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bb60a-04f9-40e1-b355-7922b58a5bf4 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:29.797912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1324/2663] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:30.261535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae1314-ceb4-43ff-aaf8-b52bafad3921 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:30.262992 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-64ae1314-ceb4-43ff-aaf8-b52bafad3921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:30.276272 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae1314-ceb4-43ff-aaf8-b52bafad3921 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:30.283716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:30.284818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:30.285179 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:30.285461 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] PATH_INFO: `/v3/projects/a502d4c9da8040a7bc22dfd53cb1c217` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:30.286832 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a502d4c9da8040a7bc22dfd53cb1c217)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:30.289146 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:30.463463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:30.474173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a502d4c9da8040a7bc22dfd53cb1c217', 'request_id': 'req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:30.480173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a502d4c9da8040a7bc22dfd53cb1c217', 'request_id': 'req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:30.487002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a502d4c9da8040a7bc22dfd53cb1c217', 'request_id': 'req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:30.637778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] The token cache is being invalidate because project a502d4c9da8040a7bc22dfd53cb1c217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:30.638432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:30.646976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:30.646976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1340/2664] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:30 2022] DELETE /identity/v3/projects/a502d4c9da8040a7bc22dfd53cb1c217 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:30.647203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bb60a-04f9-40e1-b355-7922b58a5bf4 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:30.656308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bb60a-04f9-40e1-b355-7922b58a5bf4 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:30.720228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:30.721120 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:30.721482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:30.721758 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] PATH_INFO: `/v3/users/1d25fc165e0a4ca180f50603af27db26` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:30.723088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d25fc165e0a4ca180f50603af27db26)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:30.725066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:30.749640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:31.024426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d25fc165e0a4ca180f50603af27db26'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:31.036982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d25fc165e0a4ca180f50603af27db26'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:31.157503 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d25fc165e0a4ca180f50603af27db26'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:31.158138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d25fc165e0a4ca180f50603af27db26'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:31.158749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7d0fd681-9080-4bed-8f2b-222f466072ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d25fc165e0a4ca180f50603af27db26'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:31.172738 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1325/2665] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:30 2022] DELETE /identity/v3/users/1d25fc165e0a4ca180f50603af27db26 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:31.674927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:31.678331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:31.691843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9c9a0-e8b4-4c9b-a24d-975f449623e8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:31.763313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:31.764225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:31.764515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:31.765505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] PATH_INFO: `/v3/projects/c7336efcf792489aa40f998928863804` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:31.767252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7336efcf792489aa40f998928863804)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:31.769265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:31.895062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7336efcf792489aa40f998928863804', 'request_id': 'req-fa906a53-3b02-420b-8115-e04935bd345b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:31.901198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7336efcf792489aa40f998928863804', 'request_id': 'req-fa906a53-3b02-420b-8115-e04935bd345b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:31.908359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7336efcf792489aa40f998928863804', 'request_id': 'req-fa906a53-3b02-420b-8115-e04935bd345b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:32.009264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] The token cache is being invalidate because project c7336efcf792489aa40f998928863804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:32.009571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:32.015831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:32.015831 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1341/2666] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:31 2022] DELETE /identity/v3/projects/c7336efcf792489aa40f998928863804 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:32.020867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b034b-6ec4-4024-b639-dbe7bed9df28 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:32.021440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b034b-6ec4-4024-b639-dbe7bed9df28 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:32.021818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b034b-6ec4-4024-b639-dbe7bed9df28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:32.041702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fa0b034b-6ec4-4024-b639-dbe7bed9df28 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:32.042954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fa0b034b-6ec4-4024-b639-dbe7bed9df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:32.085153 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:32.086645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:32.120520 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1326/2667] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:32.129478 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3ec71-7c7a-4b5e-b27d-39c7a3676ed9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:32.129799 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3ec71-7c7a-4b5e-b27d-39c7a3676ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:32.130080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3ec71-7c7a-4b5e-b27d-39c7a3676ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:32.148736 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3bb3ec71-7c7a-4b5e-b27d-39c7a3676ed9 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:32.149943 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3bb3ec71-7c7a-4b5e-b27d-39c7a3676ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:32.155001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa906a53-3b02-420b-8115-e04935bd345b admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:32.158471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1327/2668] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:32.159921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79632d9-9dfe-419d-86fe-e6044c494db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:32.160613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79632d9-9dfe-419d-86fe-e6044c494db1 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:32.160905 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79632d9-9dfe-419d-86fe-e6044c494db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:32.161183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79632d9-9dfe-419d-86fe-e6044c494db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:32.162713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3ec71-7c7a-4b5e-b27d-39c7a3676ed9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:32.163032 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-f79632d9-9dfe-419d-86fe-e6044c494db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:32.169337 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:32.172813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3ec71-7c7a-4b5e-b27d-39c7a3676ed9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:32.177582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a051cde-43dc-4a6b-8559-71a634c02b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:32.184514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a051cde-43dc-4a6b-8559-71a634c02b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:32.184514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a051cde-43dc-4a6b-8559-71a634c02b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:32.184514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a051cde-43dc-4a6b-8559-71a634c02b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:32.184514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a051cde-43dc-4a6b-8559-71a634c02b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:32.184514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a051cde-43dc-4a6b-8559-71a634c02b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:32.184514 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a051cde-43dc-4a6b-8559-71a634c02b95 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:32.193764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1328/2669] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:50:32.198038 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a051cde-43dc-4a6b-8559-71a634c02b95 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:32.212207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a051cde-43dc-4a6b-8559-71a634c02b95 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:32.221127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83a0a9-8d3e-4a93-9c63-65b8a4c742de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:32.223911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83a0a9-8d3e-4a93-9c63-65b8a4c742de admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:32.223911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83a0a9-8d3e-4a93-9c63-65b8a4c742de admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:32.223911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83a0a9-8d3e-4a93-9c63-65b8a4c742de admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:32.223911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83a0a9-8d3e-4a93-9c63-65b8a4c742de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:32.226589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83a0a9-8d3e-4a93-9c63-65b8a4c742de admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:32.229110 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79632d9-9dfe-419d-86fe-e6044c494db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:32.230503 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79632d9-9dfe-419d-86fe-e6044c494db1 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:32.241266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1342/2670] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:32.383679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1329/2671] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:32 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:32.387870 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79632d9-9dfe-419d-86fe-e6044c494db1 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:32.401576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79632d9-9dfe-419d-86fe-e6044c494db1 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:32.464177 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfab1c-64d9-4108-8ab3-375f7dc688f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:32.464971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfab1c-64d9-4108-8ab3-375f7dc688f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:32.465255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfab1c-64d9-4108-8ab3-375f7dc688f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:32.465531 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfab1c-64d9-4108-8ab3-375f7dc688f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:32.466250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfab1c-64d9-4108-8ab3-375f7dc688f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:32.469312 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfab1c-64d9-4108-8ab3-375f7dc688f1 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:32.631925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1343/2672] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:32 2022] POST /identity/v3/users => generated 291 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:32.636008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83a0a9-8d3e-4a93-9c63-65b8a4c742de admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:32.647020 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83a0a9-8d3e-4a93-9c63-65b8a4c742de admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:32.651567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276ebc9-dd64-4a90-9086-bf65937b4f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:32.652274 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276ebc9-dd64-4a90-9086-bf65937b4f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:32.652559 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276ebc9-dd64-4a90-9086-bf65937b4f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:32.652835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276ebc9-dd64-4a90-9086-bf65937b4f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:32.653545 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276ebc9-dd64-4a90-9086-bf65937b4f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:32.655167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276ebc9-dd64-4a90-9086-bf65937b4f52 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:32.666927 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1330/2673] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:32.670945 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfab1c-64d9-4108-8ab3-375f7dc688f1 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:32.681367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfab1c-64d9-4108-8ab3-375f7dc688f1 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:32.686077 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56654af0-77c4-4ff3-a47d-df1a0070133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:32.686751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654af0-77c4-4ff3-a47d-df1a0070133c admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:32.687076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654af0-77c4-4ff3-a47d-df1a0070133c admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:32.688579 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654af0-77c4-4ff3-a47d-df1a0070133c admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:32.690450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56654af0-77c4-4ff3-a47d-df1a0070133c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:32.692342 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56654af0-77c4-4ff3-a47d-df1a0070133c admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:32.703633 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1344/2674] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:32.707993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276ebc9-dd64-4a90-9086-bf65937b4f52 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:32.718762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276ebc9-dd64-4a90-9086-bf65937b4f52 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:32.723686 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e2a48-0491-4891-8329-7e701f7eb0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:32.724611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e2a48-0491-4891-8329-7e701f7eb0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:32.726256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e2a48-0491-4891-8329-7e701f7eb0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:32.726256 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e2a48-0491-4891-8329-7e701f7eb0e7 admin admin] PATH_INFO: `/v3/projects/a1cf3fd9c93c463b84e91e480fb9d70b/users/6a0dec33442d41a6b8545f21e876b8ed/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:32.740725 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e2a48-0491-4891-8329-7e701f7eb0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cf3fd9c93c463b84e91e480fb9d70b, user_id=6a0dec33442d41a6b8545f21e876b8ed, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:32.743438 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e2a48-0491-4891-8329-7e701f7eb0e7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:32.861395 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1331/2675] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:32 2022] PUT /identity/v3/projects/a1cf3fd9c93c463b84e91e480fb9d70b/users/6a0dec33442d41a6b8545f21e876b8ed/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:32.872500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d0b34-39c9-4ffc-a78e-92c27232f453 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:32.872846 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d0b34-39c9-4ffc-a78e-92c27232f453 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:32.873131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d0b34-39c9-4ffc-a78e-92c27232f453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:32.900876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-913d0b34-39c9-4ffc-a78e-92c27232f453 None None] MFA Rules not processed for user `6a0dec33442d41a6b8545f21e876b8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:32.902007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-913d0b34-39c9-4ffc-a78e-92c27232f453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:32.972439 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1345/2676] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:32.984323 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e2a48-0491-4891-8329-7e701f7eb0e7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:32.985881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7e3e2a48-0491-4891-8329-7e701f7eb0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:33.008702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:33.043950 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e2a48-0491-4891-8329-7e701f7eb0e7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:33.048130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b41d9-278e-4dd6-b017-535175a04349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:33.048784 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b41d9-278e-4dd6-b017-535175a04349 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:33.049067 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b41d9-278e-4dd6-b017-535175a04349 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:33.049342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b41d9-278e-4dd6-b017-535175a04349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:33.057940 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b41d9-278e-4dd6-b017-535175a04349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:33.063604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b41d9-278e-4dd6-b017-535175a04349 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:33.069843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1332/2677] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:34.324988 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d0b34-39c9-4ffc-a78e-92c27232f453 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:34.336850 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d0b34-39c9-4ffc-a78e-92c27232f453 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:34.340592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30faa6-d9f5-45ea-8be3-d21efb455f0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:34.341288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30faa6-d9f5-45ea-8be3-d21efb455f0f service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:34.341576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30faa6-d9f5-45ea-8be3-d21efb455f0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:34.341853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30faa6-d9f5-45ea-8be3-d21efb455f0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:34.344996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0d30faa6-d9f5-45ea-8be3-d21efb455f0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:34.358757 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:34.416100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30faa6-d9f5-45ea-8be3-d21efb455f0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:34.417530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30faa6-d9f5-45ea-8be3-d21efb455f0f service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:34.427942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1346/2678] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:36.754409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b41d9-278e-4dd6-b017-535175a04349 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:36.821561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b41d9-278e-4dd6-b017-535175a04349 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:36.826390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:36.827267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:36.827549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:36.827824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] PATH_INFO: `/v3/users/6a0dec33442d41a6b8545f21e876b8ed` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:36.829775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0dec33442d41a6b8545f21e876b8ed)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:36.831754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:37.141921 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0dec33442d41a6b8545f21e876b8ed'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:37.156498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0dec33442d41a6b8545f21e876b8ed'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:37.266327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0dec33442d41a6b8545f21e876b8ed'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:37.266954 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0dec33442d41a6b8545f21e876b8ed'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:37.267655 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0dec33442d41a6b8545f21e876b8ed'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:37.281220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1333/2679] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:36 2022] DELETE /identity/v3/users/6a0dec33442d41a6b8545f21e876b8ed => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:37.286045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85f188-4141-49fe-ba52-c92b2c9c9610 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:37.286555 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85f188-4141-49fe-ba52-c92b2c9c9610 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:37.286658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85f188-4141-49fe-ba52-c92b2c9c9610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:37.305310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-6a85f188-4141-49fe-ba52-c92b2c9c9610 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:37.306533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6a85f188-4141-49fe-ba52-c92b2c9c9610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:37.373490 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1347/2680] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:37.384913 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:37.386244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:37.442290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:37.455180 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333e838-7d3a-49c2-94c5-70f03a8d9361 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:37.458867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66393a66-2893-4c23-a06b-c91c70b16324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:37.459521 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393a66-2893-4c23-a06b-c91c70b16324 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:37.459801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393a66-2893-4c23-a06b-c91c70b16324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:37.460130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393a66-2893-4c23-a06b-c91c70b16324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:37.471678 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66393a66-2893-4c23-a06b-c91c70b16324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:37.473178 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66393a66-2893-4c23-a06b-c91c70b16324 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:37.483840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1334/2681] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:37.963703 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85f188-4141-49fe-ba52-c92b2c9c9610 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:37.965186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-6a85f188-4141-49fe-ba52-c92b2c9c9610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:37.978848 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85f188-4141-49fe-ba52-c92b2c9c9610 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:37.983882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:37.986468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:37.986767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:37.987054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] PATH_INFO: `/v3/projects/a1cf3fd9c93c463b84e91e480fb9d70b` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:37.988665 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1cf3fd9c93c463b84e91e480fb9d70b)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:37.990608 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:38.130948 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1cf3fd9c93c463b84e91e480fb9d70b', 'request_id': 'req-960a14cc-0615-460e-a84b-b8a09c0b0a20'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:38.143599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1cf3fd9c93c463b84e91e480fb9d70b', 'request_id': 'req-960a14cc-0615-460e-a84b-b8a09c0b0a20'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:38.148477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1cf3fd9c93c463b84e91e480fb9d70b', 'request_id': 'req-960a14cc-0615-460e-a84b-b8a09c0b0a20'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:38.226314 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] The token cache is being invalidate because project a1cf3fd9c93c463b84e91e480fb9d70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:38.226600 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:38.227261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-960a14cc-0615-460e-a84b-b8a09c0b0a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:38.228884 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1348/2682] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:37 2022] DELETE /identity/v3/projects/a1cf3fd9c93c463b84e91e480fb9d70b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:38.234169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60bf2f-6685-420e-997a-ced505277453 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:38.235341 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60bf2f-6685-420e-997a-ced505277453 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:38.235572 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60bf2f-6685-420e-997a-ced505277453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:38.262003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0d60bf2f-6685-420e-997a-ced505277453 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:38.263539 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0d60bf2f-6685-420e-997a-ced505277453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:38.343649 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1335/2683] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:38.352763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0574bb-95f4-4609-aa4a-5bf38e0d0cc9 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:38.353320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0574bb-95f4-4609-aa4a-5bf38e0d0cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:38.353427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0574bb-95f4-4609-aa4a-5bf38e0d0cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:38.374859 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-8b0574bb-95f4-4609-aa4a-5bf38e0d0cc9 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:38.376479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8b0574bb-95f4-4609-aa4a-5bf38e0d0cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:38.395450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1349/2684] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:38.395664 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60bf2f-6685-420e-997a-ced505277453 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:38.403841 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60bf2f-6685-420e-997a-ced505277453 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:38.409565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078ba47-09a5-4546-97da-a802d2d26270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:38.410271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ba47-09a5-4546-97da-a802d2d26270 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:38.410611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ba47-09a5-4546-97da-a802d2d26270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:38.410959 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078ba47-09a5-4546-97da-a802d2d26270 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:38.411785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078ba47-09a5-4546-97da-a802d2d26270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:38.412132 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078ba47-09a5-4546-97da-a802d2d26270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:38.414003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078ba47-09a5-4546-97da-a802d2d26270 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:38.434690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1336/2685] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:50:38.439488 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0574bb-95f4-4609-aa4a-5bf38e0d0cc9 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:38.449955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0574bb-95f4-4609-aa4a-5bf38e0d0cc9 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:38.455739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fb4ea-d51a-4a26-b920-67bb675d3860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:38.456464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fb4ea-d51a-4a26-b920-67bb675d3860 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:38.456747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fb4ea-d51a-4a26-b920-67bb675d3860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:38.457025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fb4ea-d51a-4a26-b920-67bb675d3860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:38.457722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fb4ea-d51a-4a26-b920-67bb675d3860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:38.459677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fb4ea-d51a-4a26-b920-67bb675d3860 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:38.539585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1350/2686] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:38 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:38.543952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078ba47-09a5-4546-97da-a802d2d26270 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:38.556211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078ba47-09a5-4546-97da-a802d2d26270 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:38.635510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80752e3-f6ed-49d6-90cc-497bb4c0e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:38.636729 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80752e3-f6ed-49d6-90cc-497bb4c0e4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:38.637185 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80752e3-f6ed-49d6-90cc-497bb4c0e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:38.637628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80752e3-f6ed-49d6-90cc-497bb4c0e4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:38.638505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80752e3-f6ed-49d6-90cc-497bb4c0e4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:38.641469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80752e3-f6ed-49d6-90cc-497bb4c0e4e8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:38.747485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1337/2687] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:38 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:38.752470 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fb4ea-d51a-4a26-b920-67bb675d3860 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:38.759802 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:38.763630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fb4ea-d51a-4a26-b920-67bb675d3860 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:38.768612 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc62f-710e-47d3-8345-1a39ce6c8037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:38.769972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc62f-710e-47d3-8345-1a39ce6c8037 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:38.769972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc62f-710e-47d3-8345-1a39ce6c8037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:38.769972 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc62f-710e-47d3-8345-1a39ce6c8037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:38.770656 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bc62f-710e-47d3-8345-1a39ce6c8037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:38.772280 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bc62f-710e-47d3-8345-1a39ce6c8037 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:38.784632 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1351/2688] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:50:38.788790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80752e3-f6ed-49d6-90cc-497bb4c0e4e8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:38.804218 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80752e3-f6ed-49d6-90cc-497bb4c0e4e8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:38.809217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17e633-f843-4dde-a183-1cd67589a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:38.810110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17e633-f843-4dde-a183-1cd67589a923 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:38.810396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17e633-f843-4dde-a183-1cd67589a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:38.810675 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17e633-f843-4dde-a183-1cd67589a923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:38.811401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17e633-f843-4dde-a183-1cd67589a923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:38.813825 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17e633-f843-4dde-a183-1cd67589a923 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:38.825015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1338/2689] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:38.829649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc62f-710e-47d3-8345-1a39ce6c8037 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:38.839877 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc62f-710e-47d3-8345-1a39ce6c8037 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:38.844940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0907edc-57cc-4ce1-91bb-e3dc854db0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:38.845906 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907edc-57cc-4ce1-91bb-e3dc854db0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:38.846174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907edc-57cc-4ce1-91bb-e3dc854db0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:38.846450 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907edc-57cc-4ce1-91bb-e3dc854db0fc admin admin] PATH_INFO: `/v3/projects/cb880ba39e4f4de4a2a887a83c5606ff/users/32afa9695c23423ab13ade82038f063d/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:38.863373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0907edc-57cc-4ce1-91bb-e3dc854db0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb880ba39e4f4de4a2a887a83c5606ff, user_id=32afa9695c23423ab13ade82038f063d, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:38.866826 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0907edc-57cc-4ce1-91bb-e3dc854db0fc admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:38.971666 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1352/2690] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:38 2022] PUT /identity/v3/projects/cb880ba39e4f4de4a2a887a83c5606ff/users/32afa9695c23423ab13ade82038f063d/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:38.982174 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1afe-5bb8-4f0b-a809-d970fee79b7c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:38.982465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1afe-5bb8-4f0b-a809-d970fee79b7c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:38.982749 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1afe-5bb8-4f0b-a809-d970fee79b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:39.012045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c00d1afe-5bb8-4f0b-a809-d970fee79b7c None None] MFA Rules not processed for user `32afa9695c23423ab13ade82038f063d`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:39.013267 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c00d1afe-5bb8-4f0b-a809-d970fee79b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:39.057345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:39.084430 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1339/2691] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:39.095982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0907edc-57cc-4ce1-91bb-e3dc854db0fc admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:39.097744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b0907edc-57cc-4ce1-91bb-e3dc854db0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:39.159062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0907edc-57cc-4ce1-91bb-e3dc854db0fc admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:39.165249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76016-cd6b-4b94-b32a-7954289e2db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:39.165249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76016-cd6b-4b94-b32a-7954289e2db8 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:39.165504 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76016-cd6b-4b94-b32a-7954289e2db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:39.165607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76016-cd6b-4b94-b32a-7954289e2db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:39.176057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76016-cd6b-4b94-b32a-7954289e2db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:39.177529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76016-cd6b-4b94-b32a-7954289e2db8 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:39.187988 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1353/2692] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:39.210211 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1afe-5bb8-4f0b-a809-d970fee79b7c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:39.211926 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c00d1afe-5bb8-4f0b-a809-d970fee79b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:39.280560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1afe-5bb8-4f0b-a809-d970fee79b7c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:39.287003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:39.287932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:39.288245 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:39.288524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] PATH_INFO: `/v3/users/da4ae20e09f24acd8797806a817203dd` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:39.289734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4ae20e09f24acd8797806a817203dd)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:39.291690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:39.680254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4ae20e09f24acd8797806a817203dd'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:39.693049 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4ae20e09f24acd8797806a817203dd'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:39.894826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4ae20e09f24acd8797806a817203dd'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:39.905304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4ae20e09f24acd8797806a817203dd'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:39.905304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4ae20e09f24acd8797806a817203dd'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:39.909427 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1340/2693] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:39 2022] DELETE /identity/v3/users/da4ae20e09f24acd8797806a817203dd => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:39.913912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b69d2-897a-4ffc-8df8-b5e99e5a5c79 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:39.914380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b69d2-897a-4ffc-8df8-b5e99e5a5c79 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:39.914505 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b69d2-897a-4ffc-8df8-b5e99e5a5c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:39.931778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a61b69d2-897a-4ffc-8df8-b5e99e5a5c79 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:39.933936 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a61b69d2-897a-4ffc-8df8-b5e99e5a5c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:39.993726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1354/2694] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:40.004575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:40.006003 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:40.064508 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cbc69-f524-4ee1-9aa8-b5758f7ecf60 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:40.071852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3c12-b7e4-4028-b351-038ed7510d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:40.071852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3c12-b7e4-4028-b351-038ed7510d26 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:40.071852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3c12-b7e4-4028-b351-038ed7510d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:40.071852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3c12-b7e4-4028-b351-038ed7510d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:40.079620 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f3c12-b7e4-4028-b351-038ed7510d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:40.081138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f3c12-b7e4-4028-b351-038ed7510d26 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:40.090988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1341/2695] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:40.837837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b69d2-897a-4ffc-8df8-b5e99e5a5c79 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:40.841008 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a61b69d2-897a-4ffc-8df8-b5e99e5a5c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:40.854178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b69d2-897a-4ffc-8df8-b5e99e5a5c79 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:40.859016 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:40.860031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:40.860357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:40.860624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] PATH_INFO: `/v3/projects/78acab55526048f68f47e562519b1a17` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:40.861894 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78acab55526048f68f47e562519b1a17)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:40.863842 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:40.998746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78acab55526048f68f47e562519b1a17', 'request_id': 'req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:41.005025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78acab55526048f68f47e562519b1a17', 'request_id': 'req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:41.011290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78acab55526048f68f47e562519b1a17', 'request_id': 'req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:41.014987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:41.084057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] The token cache is being invalidate because project 78acab55526048f68f47e562519b1a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:41.084336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:41.084955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-c8f7ba3b-48ce-4fe4-8507-631cde4e56e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:41.086538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1355/2696] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:40 2022] DELETE /identity/v3/projects/78acab55526048f68f47e562519b1a17 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:41.090713 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3c12-b7e4-4028-b351-038ed7510d26 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:41.096305 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:41.102945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3c12-b7e4-4028-b351-038ed7510d26 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:41.167130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:41.168040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:41.168417 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:41.168695 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] PATH_INFO: `/v3/users/ad3e7ecad5884cf0917deb62ac0d4cc2` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:41.169920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3e7ecad5884cf0917deb62ac0d4cc2)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:41.171821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:41.282042 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f314f4-0704-4230-8ee2-2ea859911575 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:41.282313 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f314f4-0704-4230-8ee2-2ea859911575 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:41.282623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f314f4-0704-4230-8ee2-2ea859911575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:41.300941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-48f314f4-0704-4230-8ee2-2ea859911575 None None] MFA Rules not processed for user `32afa9695c23423ab13ade82038f063d`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:41.304763 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-48f314f4-0704-4230-8ee2-2ea859911575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:41.359166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1356/2697] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:50:41.391932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3e7ecad5884cf0917deb62ac0d4cc2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:41.404792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3e7ecad5884cf0917deb62ac0d4cc2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:41.483325 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3e7ecad5884cf0917deb62ac0d4cc2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:41.483958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3e7ecad5884cf0917deb62ac0d4cc2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:41.484716 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3e7ecad5884cf0917deb62ac0d4cc2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:41.499645 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1342/2698] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:41 2022] DELETE /identity/v3/users/ad3e7ecad5884cf0917deb62ac0d4cc2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:42.027574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f314f4-0704-4230-8ee2-2ea859911575 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:42.030444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-48f314f4-0704-4230-8ee2-2ea859911575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:42.076532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f314f4-0704-4230-8ee2-2ea859911575 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:42.114169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:42.117254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:42.182660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:42.183621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:42.193647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:42.193647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] PATH_INFO: `/v3/projects/0f1b7cbf5f38454998f193d58e2aa06c` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:42.193647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1b7cbf5f38454998f193d58e2aa06c)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:42.193647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:42.213473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac06d1-d910-4408-9fee-52fc2934a08c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:42.222040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4101a6-a64b-47b3-a455-98bba5e298a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:42.226450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4101a6-a64b-47b3-a455-98bba5e298a8 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:42.226450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4101a6-a64b-47b3-a455-98bba5e298a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:42.226450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4101a6-a64b-47b3-a455-98bba5e298a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:42.226450 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6b4101a6-a64b-47b3-a455-98bba5e298a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:42.240152 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4101a6-a64b-47b3-a455-98bba5e298a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:42.241785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4101a6-a64b-47b3-a455-98bba5e298a8 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:42.252903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1343/2699] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:42.325129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1b7cbf5f38454998f193d58e2aa06c', 'request_id': 'req-dd88e05a-3f5d-46d1-8634-78cd41e86a07'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:42.335732 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1b7cbf5f38454998f193d58e2aa06c', 'request_id': 'req-dd88e05a-3f5d-46d1-8634-78cd41e86a07'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:42.342807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1b7cbf5f38454998f193d58e2aa06c', 'request_id': 'req-dd88e05a-3f5d-46d1-8634-78cd41e86a07'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:42.418718 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] The token cache is being invalidate because project 0f1b7cbf5f38454998f193d58e2aa06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:42.418966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:42.419537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:42.421160 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1357/2700] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:42 2022] DELETE /identity/v3/projects/0f1b7cbf5f38454998f193d58e2aa06c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:42.425319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4101a6-a64b-47b3-a455-98bba5e298a8 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:42.426733 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6b4101a6-a64b-47b3-a455-98bba5e298a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:42.440835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4101a6-a64b-47b3-a455-98bba5e298a8 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:42.449444 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:42.505396 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:42.506424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:42.506814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:42.507206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] PATH_INFO: `/v3/users/9b5909b0cbf94fe187e2724c55c0a038` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:42.508601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5909b0cbf94fe187e2724c55c0a038)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:42.510706 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:42.696847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5909b0cbf94fe187e2724c55c0a038'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:42.714502 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5909b0cbf94fe187e2724c55c0a038'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:42.803454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5909b0cbf94fe187e2724c55c0a038'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:42.804995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5909b0cbf94fe187e2724c55c0a038'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:42.805624 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-92aa29ec-4e2c-42cd-816f-71bdb6831a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5909b0cbf94fe187e2724c55c0a038'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:42.821533 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1344/2701] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:50:42 2022] DELETE /identity/v3/users/9b5909b0cbf94fe187e2724c55c0a038 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:50:43.405819 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:43.411140 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:43.425220 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88e05a-3f5d-46d1-8634-78cd41e86a07 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:43.459246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:43.487449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:43.488371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:43.488654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:43.488931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] PATH_INFO: `/v3/projects/de8436721234452599f000b0194f9720` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:43.490131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8436721234452599f000b0194f9720)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:43.492106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:43.729630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8436721234452599f000b0194f9720', 'request_id': 'req-d320648e-84ff-466d-a03e-b74e7d2d3ef6'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:43.735976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8436721234452599f000b0194f9720', 'request_id': 'req-d320648e-84ff-466d-a03e-b74e7d2d3ef6'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:43.742302 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8436721234452599f000b0194f9720', 'request_id': 'req-d320648e-84ff-466d-a03e-b74e7d2d3ef6'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:43.854273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] The token cache is being invalidate because project de8436721234452599f000b0194f9720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:50:43.854744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:43.855486 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-d320648e-84ff-466d-a03e-b74e7d2d3ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:50:43.857323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1358/2702] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:50:43 2022] DELETE /identity/v3/projects/de8436721234452599f000b0194f9720 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:43.869199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536a05d-a48c-4778-a711-c51cc8e9cfa7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:43.869199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536a05d-a48c-4778-a711-c51cc8e9cfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:43.869199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536a05d-a48c-4778-a711-c51cc8e9cfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:43.894942 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5536a05d-a48c-4778-a711-c51cc8e9cfa7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:43.896837 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5536a05d-a48c-4778-a711-c51cc8e9cfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:43.963881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1345/2703] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:43.973660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c73421-fd35-4799-a2ee-4262126eb3ec None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:43.974078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c73421-fd35-4799-a2ee-4262126eb3ec None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:43.974236 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c73421-fd35-4799-a2ee-4262126eb3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:44.004379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-31c73421-fd35-4799-a2ee-4262126eb3ec None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:44.006244 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-31c73421-fd35-4799-a2ee-4262126eb3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:44.014821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1359/2704] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:44.021370 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536a05d-a48c-4778-a711-c51cc8e9cfa7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:44.029077 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536a05d-a48c-4778-a711-c51cc8e9cfa7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:44.036820 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c28a6-34df-483d-ba44-42dde3f23eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:44.037495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c28a6-34df-483d-ba44-42dde3f23eca admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:44.037778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c28a6-34df-483d-ba44-42dde3f23eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:44.038054 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c28a6-34df-483d-ba44-42dde3f23eca admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:44.038779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c28a6-34df-483d-ba44-42dde3f23eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:50:44.039089 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c28a6-34df-483d-ba44-42dde3f23eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:44.042345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c28a6-34df-483d-ba44-42dde3f23eca admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:44.053938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1346/2705] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:50:44.058420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c73421-fd35-4799-a2ee-4262126eb3ec None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:44.068566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c73421-fd35-4799-a2ee-4262126eb3ec None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:44.073379 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef9ffe-bec3-49d6-902a-1cc96829fba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:44.074044 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef9ffe-bec3-49d6-902a-1cc96829fba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:44.074381 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef9ffe-bec3-49d6-902a-1cc96829fba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:44.074659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef9ffe-bec3-49d6-902a-1cc96829fba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:44.075377 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef9ffe-bec3-49d6-902a-1cc96829fba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:44.077349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef9ffe-bec3-49d6-902a-1cc96829fba4 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:44.177276 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1360/2706] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:50:44 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:50:44.181452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c28a6-34df-483d-ba44-42dde3f23eca admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:44.197401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c28a6-34df-483d-ba44-42dde3f23eca admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:44.212614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:44.264446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecdcb1-c6b0-4bd4-b333-a74a8c110583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:44.265136 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecdcb1-c6b0-4bd4-b333-a74a8c110583 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:44.265423 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecdcb1-c6b0-4bd4-b333-a74a8c110583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:44.266244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecdcb1-c6b0-4bd4-b333-a74a8c110583 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:44.266991 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecdcb1-c6b0-4bd4-b333-a74a8c110583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:44.268946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecdcb1-c6b0-4bd4-b333-a74a8c110583 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:44.348426 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1347/2707] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:50:44 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:50:44.353659 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef9ffe-bec3-49d6-902a-1cc96829fba4 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:44.376051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef9ffe-bec3-49d6-902a-1cc96829fba4 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:44.382698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbf2f8-a63f-4b22-a252-710603c3c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:44.383328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbf2f8-a63f-4b22-a252-710603c3c68a admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:44.383751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbf2f8-a63f-4b22-a252-710603c3c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:44.384031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbf2f8-a63f-4b22-a252-710603c3c68a admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:44.384806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbf2f8-a63f-4b22-a252-710603c3c68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:44.386403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbf2f8-a63f-4b22-a252-710603c3c68a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:44.401787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1361/2708] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:44.405893 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecdcb1-c6b0-4bd4-b333-a74a8c110583 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:44.420424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecdcb1-c6b0-4bd4-b333-a74a8c110583 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:44.427513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf153a-1ec9-4fe1-bb2f-b17f8fcf915a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:44.428494 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf153a-1ec9-4fe1-bb2f-b17f8fcf915a admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:44.428959 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf153a-1ec9-4fe1-bb2f-b17f8fcf915a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:44.429216 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf153a-1ec9-4fe1-bb2f-b17f8fcf915a admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:44.429948 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf153a-1ec9-4fe1-bb2f-b17f8fcf915a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:44.431603 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf153a-1ec9-4fe1-bb2f-b17f8fcf915a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:44.442944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1348/2709] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:50:44.449360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbf2f8-a63f-4b22-a252-710603c3c68a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:44.465333 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbf2f8-a63f-4b22-a252-710603c3c68a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:44.471786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224c9c3-792d-422b-9560-e8eaa4f82dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:44.472719 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224c9c3-792d-422b-9560-e8eaa4f82dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:44.472999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224c9c3-792d-422b-9560-e8eaa4f82dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:44.473270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224c9c3-792d-422b-9560-e8eaa4f82dbe admin admin] PATH_INFO: `/v3/projects/c1a1c9eaa4a5417393691921048eb2b8/users/fd91e5cd93074a729c78a1138047d14f/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:44.492495 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224c9c3-792d-422b-9560-e8eaa4f82dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a1c9eaa4a5417393691921048eb2b8, user_id=fd91e5cd93074a729c78a1138047d14f, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:44.497410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224c9c3-792d-422b-9560-e8eaa4f82dbe admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:44.617201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1362/2710] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:50:44 2022] PUT /identity/v3/projects/c1a1c9eaa4a5417393691921048eb2b8/users/fd91e5cd93074a729c78a1138047d14f/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:50:44.623780 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7bbfc-af88-4088-8619-4870c7624327 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:44.624163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7bbfc-af88-4088-8619-4870c7624327 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:44.624380 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7bbfc-af88-4088-8619-4870c7624327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:44.648999 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9ba7bbfc-af88-4088-8619-4870c7624327 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:44.651149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9ba7bbfc-af88-4088-8619-4870c7624327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:44.715314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1349/2711] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:44.726190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224c9c3-792d-422b-9560-e8eaa4f82dbe admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:44.728131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d224c9c3-792d-422b-9560-e8eaa4f82dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:44.792004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224c9c3-792d-422b-9560-e8eaa4f82dbe admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:44.795967 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e7de7-b63c-4c04-ad4a-6a0a3523cc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:44.796748 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e7de7-b63c-4c04-ad4a-6a0a3523cc3e service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:44.797204 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e7de7-b63c-4c04-ad4a-6a0a3523cc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:44.797571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e7de7-b63c-4c04-ad4a-6a0a3523cc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:44.807735 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e7de7-b63c-4c04-ad4a-6a0a3523cc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:44.809221 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e7de7-b63c-4c04-ad4a-6a0a3523cc3e service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:44.815289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:44.821142 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1363/2712] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:45.922139 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7bbfc-af88-4088-8619-4870c7624327 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:45.924301 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9ba7bbfc-af88-4088-8619-4870c7624327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:45.945900 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7bbfc-af88-4088-8619-4870c7624327 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:45.961561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db940-722c-41fc-bad6-260d34788ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:45.963146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db940-722c-41fc-bad6-260d34788ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:45.963905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db940-722c-41fc-bad6-260d34788ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:45.964133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db940-722c-41fc-bad6-260d34788ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:45.966240 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c58db940-722c-41fc-bad6-260d34788ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:45.977580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58db940-722c-41fc-bad6-260d34788ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:45.979133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58db940-722c-41fc-bad6-260d34788ef4 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:45.990318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1350/2713] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:46.358580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8de6b-9074-4dbe-bb22-2a6f306e752b None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:46.359012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8de6b-9074-4dbe-bb22-2a6f306e752b None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:46.359284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8de6b-9074-4dbe-bb22-2a6f306e752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:46.412530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-b6f8de6b-9074-4dbe-bb22-2a6f306e752b None None] MFA Rules not processed for user `fd91e5cd93074a729c78a1138047d14f`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:46.414184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b6f8de6b-9074-4dbe-bb22-2a6f306e752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:46.480012 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db940-722c-41fc-bad6-260d34788ef4 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:46.491860 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db940-722c-41fc-bad6-260d34788ef4 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:46.502635 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41408b-9fd9-42aa-b0fc-f9fd7dddb528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:46.503416 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41408b-9fd9-42aa-b0fc-f9fd7dddb528 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:46.503702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41408b-9fd9-42aa-b0fc-f9fd7dddb528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:46.505858 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41408b-9fd9-42aa-b0fc-f9fd7dddb528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:46.509818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cc41408b-9fd9-42aa-b0fc-f9fd7dddb528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:46.525887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41408b-9fd9-42aa-b0fc-f9fd7dddb528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:46.528735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41408b-9fd9-42aa-b0fc-f9fd7dddb528 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:46.543565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1351/2714] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:46.544090 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1364/2715] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:46.560393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41408b-9fd9-42aa-b0fc-f9fd7dddb528 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:46.564411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cc41408b-9fd9-42aa-b0fc-f9fd7dddb528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:46.660602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41408b-9fd9-42aa-b0fc-f9fd7dddb528 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:46.668512 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cb367-b746-4b04-8fae-fc2284ddd86d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:46.669190 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cb367-b746-4b04-8fae-fc2284ddd86d service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:46.669477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cb367-b746-4b04-8fae-fc2284ddd86d service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:46.669757 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cb367-b746-4b04-8fae-fc2284ddd86d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:46.682300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cb367-b746-4b04-8fae-fc2284ddd86d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:46.683752 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cb367-b746-4b04-8fae-fc2284ddd86d service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:46.699219 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1352/2716] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:50:46.740758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8de6b-9074-4dbe-bb22-2a6f306e752b None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:46.754097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8de6b-9074-4dbe-bb22-2a6f306e752b None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:46.758744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd5d3d-6250-4a70-909e-1b71a6dfaafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:46.759499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd5d3d-6250-4a70-909e-1b71a6dfaafe service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:46.759869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd5d3d-6250-4a70-909e-1b71a6dfaafe service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:46.760271 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd5d3d-6250-4a70-909e-1b71a6dfaafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:46.762435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-38cd5d3d-6250-4a70-909e-1b71a6dfaafe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:46.883390 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd5d3d-6250-4a70-909e-1b71a6dfaafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:46.884947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd5d3d-6250-4a70-909e-1b71a6dfaafe service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:46.898127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1365/2717] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:47.534404 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cb367-b746-4b04-8fae-fc2284ddd86d service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:47.539067 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f55cb367-b746-4b04-8fae-fc2284ddd86d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:47.567719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:50:47.575125 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cb367-b746-4b04-8fae-fc2284ddd86d service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:47.590856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf83a1-5f79-4e24-89bb-9605174a2dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:47.595626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf83a1-5f79-4e24-89bb-9605174a2dcb service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:47.595626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf83a1-5f79-4e24-89bb-9605174a2dcb service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:47.595626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf83a1-5f79-4e24-89bb-9605174a2dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:47.595626 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-17cf83a1-5f79-4e24-89bb-9605174a2dcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:47.610563 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf83a1-5f79-4e24-89bb-9605174a2dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:47.612352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf83a1-5f79-4e24-89bb-9605174a2dcb service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:47.628418 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1353/2718] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:48.645521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0fc1c-046c-47d9-bbff-17bb194ebe90 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:48.646051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0fc1c-046c-47d9-bbff-17bb194ebe90 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:48.646051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0fc1c-046c-47d9-bbff-17bb194ebe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:48.664022 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-baf0fc1c-046c-47d9-bbff-17bb194ebe90 None None] MFA Rules not processed for user `fd91e5cd93074a729c78a1138047d14f`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:50:48.665250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-baf0fc1c-046c-47d9-bbff-17bb194ebe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:48.689750 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1366/2719] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:50:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:50:49.612768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf83a1-5f79-4e24-89bb-9605174a2dcb service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:49.614373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-17cf83a1-5f79-4e24-89bb-9605174a2dcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:49.656021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf83a1-5f79-4e24-89bb-9605174a2dcb service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:49.661812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ffccd-5348-4514-ae26-bfdadc48951d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:49.662467 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ffccd-5348-4514-ae26-bfdadc48951d service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:49.662748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ffccd-5348-4514-ae26-bfdadc48951d service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:49.663021 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ffccd-5348-4514-ae26-bfdadc48951d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:49.664815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ab2ffccd-5348-4514-ae26-bfdadc48951d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:49.678400 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ffccd-5348-4514-ae26-bfdadc48951d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:49.684289 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ffccd-5348-4514-ae26-bfdadc48951d service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:49.692102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1354/2720] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:55.855277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0fc1c-046c-47d9-bbff-17bb194ebe90 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:50:55.893064 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0fc1c-046c-47d9-bbff-17bb194ebe90 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:50:55.900308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7638-e3a2-4ce0-a4bd-62aad9387e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:50:55.900980 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7638-e3a2-4ce0-a4bd-62aad9387e5c service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:50:55.901266 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7638-e3a2-4ce0-a4bd-62aad9387e5c service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:50:55.901554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7638-e3a2-4ce0-a4bd-62aad9387e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:50:55.905148 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7a9e7638-e3a2-4ce0-a4bd-62aad9387e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:50:55.940653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e7638-e3a2-4ce0-a4bd-62aad9387e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:50:55.942645 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e7638-e3a2-4ce0-a4bd-62aad9387e5c service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:50:55.955519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1367/2721] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:50:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:50:59.686165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=21 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:05.950282 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=90 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:06.349314 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f05cc3-95b8-44c8-9a87-de57b7008ef1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:06.349843 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f05cc3-95b8-44c8-9a87-de57b7008ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:06.349956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f05cc3-95b8-44c8-9a87-de57b7008ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:06.370336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-17f05cc3-95b8-44c8-9a87-de57b7008ef1 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:06.371585 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-17f05cc3-95b8-44c8-9a87-de57b7008ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:06.434106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1355/2722] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:51:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:51:06.631424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7638-e3a2-4ce0-a4bd-62aad9387e5c service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:06.635405 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7a9e7638-e3a2-4ce0-a4bd-62aad9387e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:06.730156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7638-e3a2-4ce0-a4bd-62aad9387e5c service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:06.736580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5d1f-e55b-4c3d-9903-9339dd438d5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:06.737268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5d1f-e55b-4c3d-9903-9339dd438d5f service swift] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:06.737556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5d1f-e55b-4c3d-9903-9339dd438d5f service swift] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:06.737856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5d1f-e55b-4c3d-9903-9339dd438d5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:06.747262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde5d1f-e55b-4c3d-9903-9339dd438d5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:06.748920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde5d1f-e55b-4c3d-9903-9339dd438d5f service swift] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:06.760159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1368/2723] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:51:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 17:51:07.674949 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0314-e7fa-4239-b570-6739ab83246f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:07.675435 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0314-e7fa-4239-b570-6739ab83246f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:07.675535 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0314-e7fa-4239-b570-6739ab83246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:07.695182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0ada0314-e7fa-4239-b570-6739ab83246f None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:07.696690 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0ada0314-e7fa-4239-b570-6739ab83246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:07.705424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1356/2724] 10.222.0.77 () {58 vars in 967 bytes} [Thu Jun 16 17:51:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:51:07.718433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5d1f-e55b-4c3d-9903-9339dd438d5f service swift] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:07.729403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5d1f-e55b-4c3d-9903-9339dd438d5f service swift] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:07.735347 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5505b-3824-4bb8-b9b8-f493f88a5e94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:07.736100 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5505b-3824-4bb8-b9b8-f493f88a5e94 service swift] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:07.736471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5505b-3824-4bb8-b9b8-f493f88a5e94 service swift] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:07.737273 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5505b-3824-4bb8-b9b8-f493f88a5e94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:07.750888 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5505b-3824-4bb8-b9b8-f493f88a5e94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:07.752580 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5505b-3824-4bb8-b9b8-f493f88a5e94 service swift] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:07.761165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1369/2725] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:51:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:08.715421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743a67a-62d6-4167-8c36-75f680b4e631 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:08.715956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743a67a-62d6-4167-8c36-75f680b4e631 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:08.715956 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743a67a-62d6-4167-8c36-75f680b4e631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:08.735850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1743a67a-62d6-4167-8c36-75f680b4e631 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:08.737218 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1743a67a-62d6-4167-8c36-75f680b4e631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:08.744935 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1357/2726] 10.222.0.77 () {58 vars in 1009 bytes} [Thu Jun 16 17:51:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:51:08.757823 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5505b-3824-4bb8-b9b8-f493f88a5e94 service swift] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:08.769364 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5505b-3824-4bb8-b9b8-f493f88a5e94 service swift] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:08.774508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef5aa0-3cb3-4d24-8e9a-27afa00ea984 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:08.775169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef5aa0-3cb3-4d24-8e9a-27afa00ea984 service swift] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:08.775449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef5aa0-3cb3-4d24-8e9a-27afa00ea984 service swift] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:08.775727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef5aa0-3cb3-4d24-8e9a-27afa00ea984 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:08.785334 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef5aa0-3cb3-4d24-8e9a-27afa00ea984 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:08.786931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef5aa0-3cb3-4d24-8e9a-27afa00ea984 service swift] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:08.795865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1370/2727] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:51:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:09.630228 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f663ae-c95e-4472-961e-68cfe83f29a4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:09.630519 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f663ae-c95e-4472-961e-68cfe83f29a4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:09.630802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f663ae-c95e-4472-961e-68cfe83f29a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:09.651349 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e4f663ae-c95e-4472-961e-68cfe83f29a4 None None] MFA Rules not processed for user `9f9b0c02f87340998d1736f2062b7164`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:09.652541 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e4f663ae-c95e-4472-961e-68cfe83f29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:09.660134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1358/2728] 10.222.0.77 () {58 vars in 967 bytes} [Thu Jun 16 17:51:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:51:09.672751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef5aa0-3cb3-4d24-8e9a-27afa00ea984 service swift] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:09.683293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef5aa0-3cb3-4d24-8e9a-27afa00ea984 service swift] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:09.689247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1847c-fb9a-4834-9b51-3a534967cbea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3c319430309419c895a0dc3c90ce80e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:09.689915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1847c-fb9a-4834-9b51-3a534967cbea service swift] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:09.690202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1847c-fb9a-4834-9b51-3a534967cbea service swift] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:09.690481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1847c-fb9a-4834-9b51-3a534967cbea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:09.699962 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1847c-fb9a-4834-9b51-3a534967cbea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:09.701624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1847c-fb9a-4834-9b51-3a534967cbea service swift] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:09.710054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1371/2729] 10.222.0.77 () {60 vars in 1384 bytes} [Thu Jun 16 17:51:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 17:51:12.572844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f663ae-c95e-4472-961e-68cfe83f29a4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:12.575829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e4f663ae-c95e-4472-961e-68cfe83f29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:12.627693 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f663ae-c95e-4472-961e-68cfe83f29a4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:12.636710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:12.637615 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:12.637903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:12.638181 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] PATH_INFO: `/v3/users/32afa9695c23423ab13ade82038f063d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:12.639403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] RBAC: Authorizing `identity:delete_user(user_id=32afa9695c23423ab13ade82038f063d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:12.641945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:12.903986 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32afa9695c23423ab13ade82038f063d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:51:12.926668 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32afa9695c23423ab13ade82038f063d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:51:13.013806 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32afa9695c23423ab13ade82038f063d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:51:13.014469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32afa9695c23423ab13ade82038f063d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:51:13.015368 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32afa9695c23423ab13ade82038f063d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:51:13.031779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1359/2730] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:51:12 2022] DELETE /identity/v3/users/32afa9695c23423ab13ade82038f063d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:51:13.036810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb78e1-d79b-47e2-a415-5974a5565640 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:13.037263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb78e1-d79b-47e2-a415-5974a5565640 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:13.037363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb78e1-d79b-47e2-a415-5974a5565640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:13.066433 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d5cb78e1-d79b-47e2-a415-5974a5565640 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:13.067654 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d5cb78e1-d79b-47e2-a415-5974a5565640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:13.134260 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1372/2731] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:51:13.147099 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:13.148601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:13.182304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:13.232193 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ded04-e6ba-41f1-a163-15eae618fdff admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:13.238945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bd0e8-b0a0-4f15-b927-8054784e38f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:13.240095 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bd0e8-b0a0-4f15-b927-8054784e38f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:13.241024 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bd0e8-b0a0-4f15-b927-8054784e38f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:13.241644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bd0e8-b0a0-4f15-b927-8054784e38f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:13.252923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bd0e8-b0a0-4f15-b927-8054784e38f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:13.254373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bd0e8-b0a0-4f15-b927-8054784e38f1 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:13.264443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1360/2732] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:51:13.535416 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb78e1-d79b-47e2-a415-5974a5565640 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:13.536861 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d5cb78e1-d79b-47e2-a415-5974a5565640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:13.553013 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb78e1-d79b-47e2-a415-5974a5565640 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:13.557752 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:13.558635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:13.558919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:13.559195 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] PATH_INFO: `/v3/projects/cb880ba39e4f4de4a2a887a83c5606ff` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:13.560541 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb880ba39e4f4de4a2a887a83c5606ff)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:13.563380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:13.703571 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:13.710630 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb880ba39e4f4de4a2a887a83c5606ff', 'request_id': 'req-b879fd48-1d74-4ea5-88a6-fc79cc019d59'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:51:13.716585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb880ba39e4f4de4a2a887a83c5606ff', 'request_id': 'req-b879fd48-1d74-4ea5-88a6-fc79cc019d59'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:51:13.723827 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb880ba39e4f4de4a2a887a83c5606ff', 'request_id': 'req-b879fd48-1d74-4ea5-88a6-fc79cc019d59'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:51:13.814746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] The token cache is being invalidate because project cb880ba39e4f4de4a2a887a83c5606ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:51:13.815043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:51:13.816004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:51:13.817688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1373/2733] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:51:13 2022] DELETE /identity/v3/projects/cb880ba39e4f4de4a2a887a83c5606ff => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:51:23.355962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=22 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:23.819001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:51:34.486088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87cdd-8265-49a9-b1fe-7fcfbeecebfd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:34.486671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87cdd-8265-49a9-b1fe-7fcfbeecebfd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:34.486671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87cdd-8265-49a9-b1fe-7fcfbeecebfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:34.535576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-90a87cdd-8265-49a9-b1fe-7fcfbeecebfd None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:34.536818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-90a87cdd-8265-49a9-b1fe-7fcfbeecebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:34.614643 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1361/2734] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:51:34.634078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:34.635565 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:34.713774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879fd48-1d74-4ea5-88a6-fc79cc019d59 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:34.720201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280b492-8691-4a01-aca4-2d353093773a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:34.720868 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b492-8691-4a01-aca4-2d353093773a service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:34.721156 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b492-8691-4a01-aca4-2d353093773a service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:34.721442 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b492-8691-4a01-aca4-2d353093773a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:34.730371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280b492-8691-4a01-aca4-2d353093773a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:34.731971 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280b492-8691-4a01-aca4-2d353093773a service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:34.742514 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1374/2735] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:51:39.098032 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed644bb-0991-4e3f-bda7-2a3238f8dc7e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:39.098597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed644bb-0991-4e3f-bda7-2a3238f8dc7e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:39.098597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed644bb-0991-4e3f-bda7-2a3238f8dc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:39.117809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fed644bb-0991-4e3f-bda7-2a3238f8dc7e None None] MFA Rules not processed for user `0b0a56714bbc470d93d6761d1757d448`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:39.120879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fed644bb-0991-4e3f-bda7-2a3238f8dc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:39.184133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1362/2736] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:51:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:51:39.822165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01f5ad-b914-4130-b85d-ec54e71b042d None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:39.822991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01f5ad-b914-4130-b85d-ec54e71b042d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:39.822991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01f5ad-b914-4130-b85d-ec54e71b042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:39.847268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ac01f5ad-b914-4130-b85d-ec54e71b042d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:39.848751 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ac01f5ad-b914-4130-b85d-ec54e71b042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:39.859986 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1375/2737] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:51:39.882412 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed644bb-0991-4e3f-bda7-2a3238f8dc7e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:39.884062 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fed644bb-0991-4e3f-bda7-2a3238f8dc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:39.909079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed644bb-0991-4e3f-bda7-2a3238f8dc7e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:39.916061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e185e-0a7c-473d-99ed-3422358f8256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:39.916763 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e185e-0a7c-473d-99ed-3422358f8256 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:39.917243 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e185e-0a7c-473d-99ed-3422358f8256 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:39.917390 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e185e-0a7c-473d-99ed-3422358f8256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:39.931033 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e185e-0a7c-473d-99ed-3422358f8256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:39.934130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e185e-0a7c-473d-99ed-3422358f8256 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:39.953080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1363/2738] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:51:45.668040 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfaf6d-d016-4c6f-b601-41dcb12a7b97 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:45.668681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfaf6d-d016-4c6f-b601-41dcb12a7b97 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:45.668681 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfaf6d-d016-4c6f-b601-41dcb12a7b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:45.688955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-fdbfaf6d-d016-4c6f-b601-41dcb12a7b97 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:45.690693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fdbfaf6d-d016-4c6f-b601-41dcb12a7b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:45.700769 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1376/2739] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:51:45.720461 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e185e-0a7c-473d-99ed-3422358f8256 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:45.731946 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e185e-0a7c-473d-99ed-3422358f8256 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:45.737814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef03db8-03f2-4b9a-81aa-031118fab985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:45.738481 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef03db8-03f2-4b9a-81aa-031118fab985 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:45.738770 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef03db8-03f2-4b9a-81aa-031118fab985 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:45.739047 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef03db8-03f2-4b9a-81aa-031118fab985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:45.747973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef03db8-03f2-4b9a-81aa-031118fab985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:45.751619 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef03db8-03f2-4b9a-81aa-031118fab985 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:45.760583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1364/2740] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:51:45.923617 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfaf6d-d016-4c6f-b601-41dcb12a7b97 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:45.938062 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfaf6d-d016-4c6f-b601-41dcb12a7b97 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:45.944458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbc502-172c-4afe-a403-8f3b68d6362d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:45.945133 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbc502-172c-4afe-a403-8f3b68d6362d service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:45.945436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbc502-172c-4afe-a403-8f3b68d6362d service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:45.945772 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbc502-172c-4afe-a403-8f3b68d6362d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:45.947606 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-fbfbc502-172c-4afe-a403-8f3b68d6362d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:45.960882 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbc502-172c-4afe-a403-8f3b68d6362d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:45.962489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbc502-172c-4afe-a403-8f3b68d6362d service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:45.976639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1377/2741] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:51:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:51:50.605908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952de25b-0780-4ec6-8ba9-378758b76aa5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:50.606648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952de25b-0780-4ec6-8ba9-378758b76aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:50.606648 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952de25b-0780-4ec6-8ba9-378758b76aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:50.626250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-952de25b-0780-4ec6-8ba9-378758b76aa5 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:50.627640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-952de25b-0780-4ec6-8ba9-378758b76aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:50.635762 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1365/2742] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:51:50.658301 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbc502-172c-4afe-a403-8f3b68d6362d service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:50.673340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbc502-172c-4afe-a403-8f3b68d6362d service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:50.679343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e904c5-b1aa-4914-85de-16edbedf9a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:50.680015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e904c5-b1aa-4914-85de-16edbedf9a5e service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:50.680343 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e904c5-b1aa-4914-85de-16edbedf9a5e service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:50.680626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e904c5-b1aa-4914-85de-16edbedf9a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:50.690702 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e904c5-b1aa-4914-85de-16edbedf9a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:50.692331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e904c5-b1aa-4914-85de-16edbedf9a5e service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:50.704761 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1378/2743] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:51:55.950393 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544c0f-d227-4d32-bef2-ba2d5767cc82 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:55.951030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544c0f-d227-4d32-bef2-ba2d5767cc82 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:55.951030 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544c0f-d227-4d32-bef2-ba2d5767cc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:55.971031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6e544c0f-d227-4d32-bef2-ba2d5767cc82 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:51:55.972297 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6e544c0f-d227-4d32-bef2-ba2d5767cc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:51:55.980764 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1366/2744] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:51:55.999950 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e904c5-b1aa-4914-85de-16edbedf9a5e service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:51:56.011508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e904c5-b1aa-4914-85de-16edbedf9a5e service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:51:56.018340 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1d145-c8ad-4913-99c2-ee8baea6ef73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:51:56.019004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1d145-c8ad-4913-99c2-ee8baea6ef73 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:51:56.019299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1d145-c8ad-4913-99c2-ee8baea6ef73 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:51:56.019572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1d145-c8ad-4913-99c2-ee8baea6ef73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:51:56.028588 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1d145-c8ad-4913-99c2-ee8baea6ef73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:51:56.030386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1d145-c8ad-4913-99c2-ee8baea6ef73 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:51:56.041131 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1379/2745] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 17:52:00.231409 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09cfbd-0e67-4705-a996-f88e98ef0035 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:00.231997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09cfbd-0e67-4705-a996-f88e98ef0035 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:00.231997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09cfbd-0e67-4705-a996-f88e98ef0035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:00.251493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8e09cfbd-0e67-4705-a996-f88e98ef0035 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:52:00.252767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8e09cfbd-0e67-4705-a996-f88e98ef0035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:00.260909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1367/2746] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:52:00.289256 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1d145-c8ad-4913-99c2-ee8baea6ef73 service nova] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:52:00.302306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1d145-c8ad-4913-99c2-ee8baea6ef73 service nova] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:52:00.307896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6ed2-e139-4573-ac84-620740b52a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:52:00.308668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6ed2-e139-4573-ac84-620740b52a51 service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:00.308949 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6ed2-e139-4573-ac84-620740b52a51 service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:00.309231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6ed2-e139-4573-ac84-620740b52a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:00.319136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6ed2-e139-4573-ac84-620740b52a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:52:00.320958 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6ed2-e139-4573-ac84-620740b52a51 service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:52:00.331628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1380/2747] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:52:10.245593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=84 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:10.327028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=64 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:18.578084 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f39e5-9243-4847-82b7-aae9f5bb7d4c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:18.578650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f39e5-9243-4847-82b7-aae9f5bb7d4c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:18.578772 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f39e5-9243-4847-82b7-aae9f5bb7d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:18.598683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3c0f39e5-9243-4847-82b7-aae9f5bb7d4c None None] MFA Rules not processed for user `fd91e5cd93074a729c78a1138047d14f`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:52:18.600034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3c0f39e5-9243-4847-82b7-aae9f5bb7d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:18.659664 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1368/2748] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:52:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:52:28.651867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=25 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:52:39.517968 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76bee0-eabc-4553-9b77-c9f724260e12 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:39.518576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76bee0-eabc-4553-9b77-c9f724260e12 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:39.518576 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76bee0-eabc-4553-9b77-c9f724260e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:39.538025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-2b76bee0-eabc-4553-9b77-c9f724260e12 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:52:39.539242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-2b76bee0-eabc-4553-9b77-c9f724260e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:39.548308 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1381/2749] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:52:39.567604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f39e5-9243-4847-82b7-aae9f5bb7d4c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:52:39.588197 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f39e5-9243-4847-82b7-aae9f5bb7d4c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:52:39.594581 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b4062-749b-486c-934c-9c989125028d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:52:39.595282 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4062-749b-486c-934c-9c989125028d service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:39.595567 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4062-749b-486c-934c-9c989125028d service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:39.595847 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4062-749b-486c-934c-9c989125028d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:39.604575 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b4062-749b-486c-934c-9c989125028d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:52:39.607239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b4062-749b-486c-934c-9c989125028d service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:52:39.617161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1369/2750] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:52:44.043206 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a10c-a833-4636-b087-25e7710ff7c7 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:44.044560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a10c-a833-4636-b087-25e7710ff7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:44.044845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a10c-a833-4636-b087-25e7710ff7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:44.064191 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-ba03a10c-a833-4636-b087-25e7710ff7c7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:52:44.067973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ba03a10c-a833-4636-b087-25e7710ff7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:44.073521 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1382/2751] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:52:44.093225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b4062-749b-486c-934c-9c989125028d service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:52:44.104459 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b4062-749b-486c-934c-9c989125028d service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:52:44.110714 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c181a5-0946-4293-a38f-3ff9f9837dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:52:44.111350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c181a5-0946-4293-a38f-3ff9f9837dbf service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:44.111632 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c181a5-0946-4293-a38f-3ff9f9837dbf service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:44.111907 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c181a5-0946-4293-a38f-3ff9f9837dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:44.120104 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c181a5-0946-4293-a38f-3ff9f9837dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:52:44.122601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c181a5-0946-4293-a38f-3ff9f9837dbf service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:52:44.132150 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1370/2752] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:52:45.173678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03a10c-a833-4636-b087-25e7710ff7c7 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:52:45.175084 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ba03a10c-a833-4636-b087-25e7710ff7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:45.235401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03a10c-a833-4636-b087-25e7710ff7c7 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:52:45.239031 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc304-fbf2-4acf-9673-ee9df7c27c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:52:45.243512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc304-fbf2-4acf-9673-ee9df7c27c4a service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:45.243512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc304-fbf2-4acf-9673-ee9df7c27c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:45.243512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc304-fbf2-4acf-9673-ee9df7c27c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:45.243512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-682cc304-fbf2-4acf-9673-ee9df7c27c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:45.307607 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cc304-fbf2-4acf-9673-ee9df7c27c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:52:45.309743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cc304-fbf2-4acf-9673-ee9df7c27c4a service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:52:45.319213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1383/2753] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:52:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:52:47.990320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7ac0-d0d5-4f86-b01c-f9de1904ba22 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:47.990320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7ac0-d0d5-4f86-b01c-f9de1904ba22 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:47.990320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7ac0-d0d5-4f86-b01c-f9de1904ba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:48.007840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d6ea7ac0-d0d5-4f86-b01c-f9de1904ba22 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:52:48.009699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d6ea7ac0-d0d5-4f86-b01c-f9de1904ba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:48.018609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1371/2754] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:52:48.039419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc304-fbf2-4acf-9673-ee9df7c27c4a service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:52:48.053378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc304-fbf2-4acf-9673-ee9df7c27c4a service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:52:48.060982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c8b9f-b27c-4d22-99e8-4cce5556451b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:52:48.061652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c8b9f-b27c-4d22-99e8-4cce5556451b service nova] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:48.063056 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c8b9f-b27c-4d22-99e8-4cce5556451b service nova] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:48.063349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c8b9f-b27c-4d22-99e8-4cce5556451b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:48.072351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c8b9f-b27c-4d22-99e8-4cce5556451b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:52:48.073952 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c8b9f-b27c-4d22-99e8-4cce5556451b service nova] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:52:48.084048 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1384/2755] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:52:51.444495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea7ac0-d0d5-4f86-b01c-f9de1904ba22 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:52:51.445961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d6ea7ac0-d0d5-4f86-b01c-f9de1904ba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:51.541967 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea7ac0-d0d5-4f86-b01c-f9de1904ba22 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:52:51.547231 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5771e6-c251-40b1-a9fd-bee22797e451 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:52:51.547887 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5771e6-c251-40b1-a9fd-bee22797e451 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:51.548191 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5771e6-c251-40b1-a9fd-bee22797e451 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:51.548473 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5771e6-c251-40b1-a9fd-bee22797e451 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:51.550259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bc5771e6-c251-40b1-a9fd-bee22797e451 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:51.562723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5771e6-c251-40b1-a9fd-bee22797e451 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:52:51.564375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5771e6-c251-40b1-a9fd-bee22797e451 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:52:51.574918 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1372/2756] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:52:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:52:52.280208 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249e14-db4f-4749-b17d-5f355a7c08db None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:52.285446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249e14-db4f-4749-b17d-5f355a7c08db None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:52.285446 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249e14-db4f-4749-b17d-5f355a7c08db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:52.299727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-51249e14-db4f-4749-b17d-5f355a7c08db None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:52:52.300999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-51249e14-db4f-4749-b17d-5f355a7c08db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:52.309059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1385/2757] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:52:52.328964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5771e6-c251-40b1-a9fd-bee22797e451 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:52:52.342591 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5771e6-c251-40b1-a9fd-bee22797e451 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:52:52.348201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a409b-e634-4c15-a17b-c4cc701b7bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:52:52.348853 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a409b-e634-4c15-a17b-c4cc701b7bcf service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:52.349141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a409b-e634-4c15-a17b-c4cc701b7bcf service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:52.349419 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a409b-e634-4c15-a17b-c4cc701b7bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:52.358933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a409b-e634-4c15-a17b-c4cc701b7bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:52:52.360568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a409b-e634-4c15-a17b-c4cc701b7bcf service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:52:52.370454 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1373/2758] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:52:53.147835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51249e14-db4f-4749-b17d-5f355a7c08db None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:52:53.149284 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-51249e14-db4f-4749-b17d-5f355a7c08db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:53.162332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51249e14-db4f-4749-b17d-5f355a7c08db None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:52:53.166073 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1fa4e-bcbe-40ec-8ff5-f8b25b8cd46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:52:53.166787 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1fa4e-bcbe-40ec-8ff5-f8b25b8cd46a service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:53.167106 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1fa4e-bcbe-40ec-8ff5-f8b25b8cd46a service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:53.167582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1fa4e-bcbe-40ec-8ff5-f8b25b8cd46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:53.170673 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-bdc1fa4e-bcbe-40ec-8ff5-f8b25b8cd46a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:53.183072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1fa4e-bcbe-40ec-8ff5-f8b25b8cd46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:52:53.185660 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1fa4e-bcbe-40ec-8ff5-f8b25b8cd46a service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:52:53.196193 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1386/2759] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:52:56.609410 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa001-5544-4c6c-a788-723dffe66588 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:56.610167 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa001-5544-4c6c-a788-723dffe66588 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:56.610634 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa001-5544-4c6c-a788-723dffe66588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:56.631333 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f38aa001-5544-4c6c-a788-723dffe66588 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:52:56.632876 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f38aa001-5544-4c6c-a788-723dffe66588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:56.642411 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1374/2760] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Jun 16 17:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:52:56.673917 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1fa4e-bcbe-40ec-8ff5-f8b25b8cd46a service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:52:56.677057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-bdc1fa4e-bcbe-40ec-8ff5-f8b25b8cd46a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:56.697633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38aa001-5544-4c6c-a788-723dffe66588 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:52:56.711157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1fa4e-bcbe-40ec-8ff5-f8b25b8cd46a service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:52:56.719412 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2350c-d9fc-4200-afaa-69e02ce6e8eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:52:56.720225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2350c-d9fc-4200-afaa-69e02ce6e8eb service placement] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:56.720585 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2350c-d9fc-4200-afaa-69e02ce6e8eb service placement] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:56.720933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2350c-d9fc-4200-afaa-69e02ce6e8eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:56.722124 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38aa001-5544-4c6c-a788-723dffe66588 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:52:56.723051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cea2350c-d9fc-4200-afaa-69e02ce6e8eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:52:56.729406 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc526a83-b113-4f9e-bd54-f507e202c6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0bb071b7c04e1da55259f079a9c805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:52:56.730088 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc526a83-b113-4f9e-bd54-f507e202c6df service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:52:56.730604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc526a83-b113-4f9e-bd54-f507e202c6df service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:52:56.731469 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc526a83-b113-4f9e-bd54-f507e202c6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:52:56.740464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2350c-d9fc-4200-afaa-69e02ce6e8eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:52:56.742068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2350c-d9fc-4200-afaa-69e02ce6e8eb service placement] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:52:56.742261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc526a83-b113-4f9e-bd54-f507e202c6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:52:56.743852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc526a83-b113-4f9e-bd54-f507e202c6df service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:52:56.754955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1375/2761] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:52:56.757216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1387/2762] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:52:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:53:00.794535 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2350c-d9fc-4200-afaa-69e02ce6e8eb service placement] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:00.796938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-cea2350c-d9fc-4200-afaa-69e02ce6e8eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:00.806052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=76 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:00.814430 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2350c-d9fc-4200-afaa-69e02ce6e8eb service placement] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:00.819738 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:00.820964 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:00.821246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:00.821519 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] PATH_INFO: `/v3/users/01866477c9d04ffc87c126508ecaf0e4` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:00.822933 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01866477c9d04ffc87c126508ecaf0e4)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:00.826037 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:01.093794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01866477c9d04ffc87c126508ecaf0e4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:01.107599 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01866477c9d04ffc87c126508ecaf0e4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:01.186464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01866477c9d04ffc87c126508ecaf0e4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:01.188332 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01866477c9d04ffc87c126508ecaf0e4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:01.189409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01866477c9d04ffc87c126508ecaf0e4'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:01.205961 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1388/2763] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:53:00 2022] DELETE /identity/v3/users/01866477c9d04ffc87c126508ecaf0e4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:01.474151 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc526a83-b113-4f9e-bd54-f507e202c6df service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:01.485199 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc526a83-b113-4f9e-bd54-f507e202c6df service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:01.537710 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:01.543640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:01.544547 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:01.544824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:01.545097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] PATH_INFO: `/v3/projects/564a4a11032e43ffa93421e9ff96ddec` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:01.546302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=564a4a11032e43ffa93421e9ff96ddec)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:01.548242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:01.703080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564a4a11032e43ffa93421e9ff96ddec', 'request_id': 'req-5c204917-7b0f-41ea-9c25-37dc4b312202'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:01.708717 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564a4a11032e43ffa93421e9ff96ddec', 'request_id': 'req-5c204917-7b0f-41ea-9c25-37dc4b312202'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:01.768808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564a4a11032e43ffa93421e9ff96ddec', 'request_id': 'req-5c204917-7b0f-41ea-9c25-37dc4b312202'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:01.782166 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] The token cache is being invalidate because project 564a4a11032e43ffa93421e9ff96ddec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:53:01.782451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:01.783106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:01.784803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1376/2764] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:53:01 2022] DELETE /identity/v3/projects/564a4a11032e43ffa93421e9ff96ddec => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:01.788807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:01.790512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:01.804652 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e4517-111f-4685-8e7f-db9104b7ead4 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:01.878351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:01.879226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:01.879508 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:01.879780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] PATH_INFO: `/v3/users/ace680dd9b6c493fa60aef465623ca5e` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:01.880988 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace680dd9b6c493fa60aef465623ca5e)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:01.882896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:02.128254 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace680dd9b6c493fa60aef465623ca5e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:02.143582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace680dd9b6c493fa60aef465623ca5e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:02.278167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace680dd9b6c493fa60aef465623ca5e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:02.280795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace680dd9b6c493fa60aef465623ca5e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:02.280795 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace680dd9b6c493fa60aef465623ca5e'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:02.286811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:02.297173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1389/2765] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:53:01 2022] DELETE /identity/v3/users/ace680dd9b6c493fa60aef465623ca5e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:02.584327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:02.585818 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:02.600382 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c204917-7b0f-41ea-9c25-37dc4b312202 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:02.660775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:02.661652 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:02.661932 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:02.662205 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] PATH_INFO: `/v3/projects/5466dad56dbb455cac62d883774f3d8c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:02.663403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5466dad56dbb455cac62d883774f3d8c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:02.665434 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:02.812819 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5466dad56dbb455cac62d883774f3d8c', 'request_id': 'req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:02.818278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5466dad56dbb455cac62d883774f3d8c', 'request_id': 'req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:02.913240 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5466dad56dbb455cac62d883774f3d8c', 'request_id': 'req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:02.925156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] The token cache is being invalidate because project 5466dad56dbb455cac62d883774f3d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:53:02.925448 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:02.926075 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:02.927707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1377/2766] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:53:02 2022] DELETE /identity/v3/projects/5466dad56dbb455cac62d883774f3d8c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:12.665462 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:12.922123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=76,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:33.478810 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:33.481189 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:33.561965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08573-5270-42c6-b458-c8d8700fad86 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:33.624692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe34051-578a-4472-bde0-7ec23ec0ff6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:33.625481 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe34051-578a-4472-bde0-7ec23ec0ff6f service placement] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:33.625766 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe34051-578a-4472-bde0-7ec23ec0ff6f service placement] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:33.626045 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe34051-578a-4472-bde0-7ec23ec0ff6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:33.627860 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-dfe34051-578a-4472-bde0-7ec23ec0ff6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:33.643700 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe34051-578a-4472-bde0-7ec23ec0ff6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:33.645382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe34051-578a-4472-bde0-7ec23ec0ff6f service placement] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:33.647422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:33.649735 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:33.664907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1390/2767] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:53:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:53:33.727509 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656602d5-37b9-44ea-9a4f-5a36be9b8c9d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:33.732466 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:33.733362 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:33.733653 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:33.733929 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] PATH_INFO: `/v3/users/fd91e5cd93074a729c78a1138047d14f` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:33.735121 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd91e5cd93074a729c78a1138047d14f)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:33.737085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:34.093930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd91e5cd93074a729c78a1138047d14f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:34.114789 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd91e5cd93074a729c78a1138047d14f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:34.203855 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd91e5cd93074a729c78a1138047d14f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:34.204609 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd91e5cd93074a729c78a1138047d14f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:34.205286 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d7ba8190-f045-471b-9f83-819afc0bcda3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd91e5cd93074a729c78a1138047d14f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:34.221343 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1378/2768] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:53:33 2022] DELETE /identity/v3/users/fd91e5cd93074a729c78a1138047d14f => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:53:34.552482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe34051-578a-4472-bde0-7ec23ec0ff6f service placement] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:34.564692 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe34051-578a-4472-bde0-7ec23ec0ff6f service placement] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:34.638637 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:34.639522 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:34.639803 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:34.640093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] PATH_INFO: `/v3/projects/c1a1c9eaa4a5417393691921048eb2b8` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:34.641385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a1c9eaa4a5417393691921048eb2b8)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:34.643331 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:34.799593 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:34.809855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a1c9eaa4a5417393691921048eb2b8', 'request_id': 'req-3303063f-3dad-4ce2-9551-809464c68130'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:34.819261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a1c9eaa4a5417393691921048eb2b8', 'request_id': 'req-3303063f-3dad-4ce2-9551-809464c68130'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:34.825420 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a1c9eaa4a5417393691921048eb2b8', 'request_id': 'req-3303063f-3dad-4ce2-9551-809464c68130'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:34.927413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] The token cache is being invalidate because project c1a1c9eaa4a5417393691921048eb2b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:53:34.927704 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:34.928451 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-3303063f-3dad-4ce2-9551-809464c68130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:34.935623 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1391/2769] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:53:34 2022] DELETE /identity/v3/projects/c1a1c9eaa4a5417393691921048eb2b8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:34.936009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb44414-a260-4221-a29c-9bfaf1053f3d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:34.936009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb44414-a260-4221-a29c-9bfaf1053f3d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:34.936009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb44414-a260-4221-a29c-9bfaf1053f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:34.954957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8eb44414-a260-4221-a29c-9bfaf1053f3d None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:34.956345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8eb44414-a260-4221-a29c-9bfaf1053f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:35.025201 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1379/2770] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:35.033568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930409c-3953-44cd-8c58-af2191a6ef52 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:35.033880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930409c-3953-44cd-8c58-af2191a6ef52 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:35.034157 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930409c-3953-44cd-8c58-af2191a6ef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:35.055473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-0930409c-3953-44cd-8c58-af2191a6ef52 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:35.056821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0930409c-3953-44cd-8c58-af2191a6ef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:35.067833 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1392/2771] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:35.071018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb44414-a260-4221-a29c-9bfaf1053f3d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:35.082882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb44414-a260-4221-a29c-9bfaf1053f3d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:35.087890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d3790-c3ac-40a4-a628-0a5dc3623e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:35.089504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d3790-c3ac-40a4-a628-0a5dc3623e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:35.089775 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d3790-c3ac-40a4-a628-0a5dc3623e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:35.090189 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d3790-c3ac-40a4-a628-0a5dc3623e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:35.090894 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d3790-c3ac-40a4-a628-0a5dc3623e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:53:35.091207 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d3790-c3ac-40a4-a628-0a5dc3623e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:35.092882 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d3790-c3ac-40a4-a628-0a5dc3623e95 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:35.111856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1380/2772] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:53:35.112143 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930409c-3953-44cd-8c58-af2191a6ef52 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:35.120720 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930409c-3953-44cd-8c58-af2191a6ef52 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:35.125449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386917e-d6f2-456c-96e9-6d3b4fe8b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:35.126174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386917e-d6f2-456c-96e9-6d3b4fe8b816 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:35.126455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386917e-d6f2-456c-96e9-6d3b4fe8b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:35.126728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386917e-d6f2-456c-96e9-6d3b4fe8b816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:35.127432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386917e-d6f2-456c-96e9-6d3b4fe8b816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:35.129369 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386917e-d6f2-456c-96e9-6d3b4fe8b816 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:35.204581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1393/2773] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:53:35 2022] POST /identity/v3/projects => generated 397 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:53:35.208768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d3790-c3ac-40a4-a628-0a5dc3623e95 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:35.218877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d3790-c3ac-40a4-a628-0a5dc3623e95 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:35.222543 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:35.280988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56338-cc04-4015-90e5-242c76193873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:35.282097 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56338-cc04-4015-90e5-242c76193873 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:35.282532 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56338-cc04-4015-90e5-242c76193873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:35.283031 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56338-cc04-4015-90e5-242c76193873 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:35.283905 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d56338-cc04-4015-90e5-242c76193873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:35.289365 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d56338-cc04-4015-90e5-242c76193873 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:35.381029 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1381/2774] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:53:35 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:53:35.385153 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386917e-d6f2-456c-96e9-6d3b4fe8b816 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:35.396380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386917e-d6f2-456c-96e9-6d3b4fe8b816 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:35.400982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3508282-0273-444b-9012-edba24ec8428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:35.401691 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508282-0273-444b-9012-edba24ec8428 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:35.401979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508282-0273-444b-9012-edba24ec8428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:35.402255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508282-0273-444b-9012-edba24ec8428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:35.402978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3508282-0273-444b-9012-edba24ec8428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:35.404618 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3508282-0273-444b-9012-edba24ec8428 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:35.415202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1394/2775] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:53:35.419389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56338-cc04-4015-90e5-242c76193873 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:35.429578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56338-cc04-4015-90e5-242c76193873 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:35.434982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fe65d-0ca5-4686-a13e-10fad0e822c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:35.435888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fe65d-0ca5-4686-a13e-10fad0e822c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:35.436224 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fe65d-0ca5-4686-a13e-10fad0e822c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:35.436510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fe65d-0ca5-4686-a13e-10fad0e822c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:35.437233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fe65d-0ca5-4686-a13e-10fad0e822c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:35.438824 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fe65d-0ca5-4686-a13e-10fad0e822c1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:35.449671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1382/2776] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:53:35.453864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3508282-0273-444b-9012-edba24ec8428 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:35.464248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3508282-0273-444b-9012-edba24ec8428 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:35.468463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a7e4-4091-42f9-a62c-e302e42b0b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:35.469346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a7e4-4091-42f9-a62c-e302e42b0b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:35.469624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a7e4-4091-42f9-a62c-e302e42b0b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:35.469896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a7e4-4091-42f9-a62c-e302e42b0b37 admin admin] PATH_INFO: `/v3/projects/6b1de9231af54173a08f5510c9fe05ea/users/0eb74055cb484ec5969632e150f9fe4f/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:35.485549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8a7e4-4091-42f9-a62c-e302e42b0b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1de9231af54173a08f5510c9fe05ea, user_id=0eb74055cb484ec5969632e150f9fe4f, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:35.488198 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8a7e4-4091-42f9-a62c-e302e42b0b37 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:35.535358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1395/2777] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:53:35 2022] PUT /identity/v3/projects/6b1de9231af54173a08f5510c9fe05ea/users/0eb74055cb484ec5969632e150f9fe4f/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:35.550009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96c968-e93e-4b8b-b3f0-894f3973eb72 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:35.550009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96c968-e93e-4b8b-b3f0-894f3973eb72 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:35.550009 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96c968-e93e-4b8b-b3f0-894f3973eb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:35.581304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-aa96c968-e93e-4b8b-b3f0-894f3973eb72 None None] MFA Rules not processed for user `0eb74055cb484ec5969632e150f9fe4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:35.582678 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-aa96c968-e93e-4b8b-b3f0-894f3973eb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:35.648327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1383/2778] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:35.660336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a7e4-4091-42f9-a62c-e302e42b0b37 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:35.662118 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-01d8a7e4-4091-42f9-a62c-e302e42b0b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:35.748262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a7e4-4091-42f9-a62c-e302e42b0b37 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:35.752003 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c810f0-879a-4379-abfc-a0cbfa1c0888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:35.752778 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c810f0-879a-4379-abfc-a0cbfa1c0888 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:35.752960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c810f0-879a-4379-abfc-a0cbfa1c0888 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:35.753259 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c810f0-879a-4379-abfc-a0cbfa1c0888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:35.762463 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c810f0-879a-4379-abfc-a0cbfa1c0888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:35.763916 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c810f0-879a-4379-abfc-a0cbfa1c0888 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:35.773403 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1396/2779] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:53:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:53:40.743239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96c968-e93e-4b8b-b3f0-894f3973eb72 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:40.744676 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-aa96c968-e93e-4b8b-b3f0-894f3973eb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:40.817576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96c968-e93e-4b8b-b3f0-894f3973eb72 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:40.821232 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b383db-eb4b-4944-871b-89d4589c21ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:40.823617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b383db-eb4b-4944-871b-89d4589c21ed service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:40.823617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b383db-eb4b-4944-871b-89d4589c21ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:40.823617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b383db-eb4b-4944-871b-89d4589c21ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:40.825220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-14b383db-eb4b-4944-871b-89d4589c21ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:40.862092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:40.895250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b383db-eb4b-4944-871b-89d4589c21ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:40.896728 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b383db-eb4b-4944-871b-89d4589c21ed service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:40.907498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1384/2780] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:53:42.067225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c810f0-879a-4379-abfc-a0cbfa1c0888 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:42.081966 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c810f0-879a-4379-abfc-a0cbfa1c0888 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:42.090790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:42.091789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:42.092223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:42.092577 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] PATH_INFO: `/v3/users/0eb74055cb484ec5969632e150f9fe4f` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:42.093942 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb74055cb484ec5969632e150f9fe4f)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:42.096507 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:42.294436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:42.312479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb74055cb484ec5969632e150f9fe4f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:42.325947 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb74055cb484ec5969632e150f9fe4f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:42.395999 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb74055cb484ec5969632e150f9fe4f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:42.397351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb74055cb484ec5969632e150f9fe4f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:42.397977 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb74055cb484ec5969632e150f9fe4f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:42.412685 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1397/2781] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:53:42 2022] DELETE /identity/v3/users/0eb74055cb484ec5969632e150f9fe4f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:42.418321 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa898500-0269-471e-bf0a-d5a73e7e2142 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:42.418881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa898500-0269-471e-bf0a-d5a73e7e2142 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:42.420640 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa898500-0269-471e-bf0a-d5a73e7e2142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:42.439302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-aa898500-0269-471e-bf0a-d5a73e7e2142 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:42.440574 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-aa898500-0269-471e-bf0a-d5a73e7e2142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:42.518056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1385/2782] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:42.525231 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:42.526925 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:42.597994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98e055-d795-411c-88f4-00ba5f2cd547 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:42.602264 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991a4a-9564-4950-abde-c886b7cffa35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:42.602936 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991a4a-9564-4950-abde-c886b7cffa35 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:42.603410 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991a4a-9564-4950-abde-c886b7cffa35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:42.603693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991a4a-9564-4950-abde-c886b7cffa35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:42.613896 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33991a4a-9564-4950-abde-c886b7cffa35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:42.615352 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33991a4a-9564-4950-abde-c886b7cffa35 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:42.626184 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1398/2783] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:53:43.074439 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa898500-0269-471e-bf0a-d5a73e7e2142 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:43.076035 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-aa898500-0269-471e-bf0a-d5a73e7e2142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:43.106008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa898500-0269-471e-bf0a-d5a73e7e2142 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:43.112352 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:43.113388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:43.113740 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:43.114085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] PATH_INFO: `/v3/projects/6b1de9231af54173a08f5510c9fe05ea` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:43.115528 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1de9231af54173a08f5510c9fe05ea)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:43.117994 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:43.251043 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1de9231af54173a08f5510c9fe05ea', 'request_id': 'req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:43.257366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1de9231af54173a08f5510c9fe05ea', 'request_id': 'req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:43.352311 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1de9231af54173a08f5510c9fe05ea', 'request_id': 'req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:43.364826 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] The token cache is being invalidate because project 6b1de9231af54173a08f5510c9fe05ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:53:43.365123 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:43.365809 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:43.367585 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1386/2784] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:53:43 2022] DELETE /identity/v3/projects/6b1de9231af54173a08f5510c9fe05ea => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:44.994007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991a4a-9564-4950-abde-c886b7cffa35 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:44.997487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-33991a4a-9564-4950-abde-c886b7cffa35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:45.013688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991a4a-9564-4950-abde-c886b7cffa35 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:45.072540 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:45.074004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:45.074285 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:45.074560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] PATH_INFO: `/v3/users/0b0a56714bbc470d93d6761d1757d448` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:45.075790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0a56714bbc470d93d6761d1757d448)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:45.077746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:45.302250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0a56714bbc470d93d6761d1757d448'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:45.310762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:45.315937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0a56714bbc470d93d6761d1757d448'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:45.390255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0a56714bbc470d93d6761d1757d448'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:45.390943 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0a56714bbc470d93d6761d1757d448'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:45.391560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-1bbac6c8-e3c3-4da7-9e4e-a360c3ed9dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0a56714bbc470d93d6761d1757d448'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:45.408669 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1399/2785] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:53:44 2022] DELETE /identity/v3/users/0b0a56714bbc470d93d6761d1757d448 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:45.714601 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:45.717080 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:45.732015 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9f0ff-ebb0-48a0-85d4-8532262c82d6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:45.784585 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:45.798153 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:45.799058 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:45.799344 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:45.799618 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] PATH_INFO: `/v3/projects/075db4ca21b445018e8f05df1a81a07e` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:45.800881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] RBAC: Authorizing `identity:delete_project(project_id=075db4ca21b445018e8f05df1a81a07e)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:45.802971 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:46.046679 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075db4ca21b445018e8f05df1a81a07e', 'request_id': 'req-890b72c6-1710-4343-bc90-6072eca4acda'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:46.051987 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075db4ca21b445018e8f05df1a81a07e', 'request_id': 'req-890b72c6-1710-4343-bc90-6072eca4acda'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:46.300869 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075db4ca21b445018e8f05df1a81a07e', 'request_id': 'req-890b72c6-1710-4343-bc90-6072eca4acda'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:46.315914 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] The token cache is being invalidate because project 075db4ca21b445018e8f05df1a81a07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:53:46.316471 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:46.317234 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-890b72c6-1710-4343-bc90-6072eca4acda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:46.319318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1387/2786] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:53:45 2022] DELETE /identity/v3/projects/075db4ca21b445018e8f05df1a81a07e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:53:46.324459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4a7d3-0f81-4994-9d7f-880779dc55d7 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:46.330319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4a7d3-0f81-4994-9d7f-880779dc55d7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:46.330319 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4a7d3-0f81-4994-9d7f-880779dc55d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:46.345029 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-60a4a7d3-0f81-4994-9d7f-880779dc55d7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:46.346251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-60a4a7d3-0f81-4994-9d7f-880779dc55d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:46.407043 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1400/2787] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:46.415109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b88f7-5be2-4088-a742-9d8f27de96a3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:46.415407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b88f7-5be2-4088-a742-9d8f27de96a3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:46.415722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b88f7-5be2-4088-a742-9d8f27de96a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:46.436915 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d27b88f7-5be2-4088-a742-9d8f27de96a3 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:46.438147 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d27b88f7-5be2-4088-a742-9d8f27de96a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:46.446667 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1388/2788] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:46.451336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4a7d3-0f81-4994-9d7f-880779dc55d7 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:46.461375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4a7d3-0f81-4994-9d7f-880779dc55d7 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:46.466570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c81fe-2b51-4426-9a50-37abcd9717f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:46.467230 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c81fe-2b51-4426-9a50-37abcd9717f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:46.467512 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c81fe-2b51-4426-9a50-37abcd9717f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:46.467788 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c81fe-2b51-4426-9a50-37abcd9717f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:46.468538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c81fe-2b51-4426-9a50-37abcd9717f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:53:46.468845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c81fe-2b51-4426-9a50-37abcd9717f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:46.470432 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c81fe-2b51-4426-9a50-37abcd9717f2 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:46.483440 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1401/2789] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:53:46.487832 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b88f7-5be2-4088-a742-9d8f27de96a3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:46.498025 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b88f7-5be2-4088-a742-9d8f27de96a3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:46.502732 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe9bdc-ddbb-466d-b4f4-bc59a4be450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:46.503394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9bdc-ddbb-466d-b4f4-bc59a4be450c admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:46.503682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9bdc-ddbb-466d-b4f4-bc59a4be450c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:46.503962 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9bdc-ddbb-466d-b4f4-bc59a4be450c admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:46.504685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe9bdc-ddbb-466d-b4f4-bc59a4be450c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:46.506598 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe9bdc-ddbb-466d-b4f4-bc59a4be450c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:46.651272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1389/2790] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:53:46 2022] POST /identity/v3/projects => generated 405 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:53:46.656288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c81fe-2b51-4426-9a50-37abcd9717f2 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:46.666606 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c81fe-2b51-4426-9a50-37abcd9717f2 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:46.730026 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235a30e-df9e-4a6f-bf4b-37564eebdfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:46.730790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235a30e-df9e-4a6f-bf4b-37564eebdfa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:46.731104 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235a30e-df9e-4a6f-bf4b-37564eebdfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:46.731384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235a30e-df9e-4a6f-bf4b-37564eebdfa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:46.732097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235a30e-df9e-4a6f-bf4b-37564eebdfa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:46.734089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235a30e-df9e-4a6f-bf4b-37564eebdfa4 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:46.862663 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1402/2791] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:53:46 2022] POST /identity/v3/users => generated 303 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:53:46.866750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe9bdc-ddbb-466d-b4f4-bc59a4be450c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:46.878718 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe9bdc-ddbb-466d-b4f4-bc59a4be450c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:46.883558 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebd490-637f-4251-b608-a096862a0a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:46.884269 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebd490-637f-4251-b608-a096862a0a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:46.884564 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebd490-637f-4251-b608-a096862a0a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:46.884830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebd490-637f-4251-b608-a096862a0a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:46.885778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebd490-637f-4251-b608-a096862a0a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:46.887467 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebd490-637f-4251-b608-a096862a0a65 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:46.898985 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1390/2792] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:53:46.903213 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235a30e-df9e-4a6f-bf4b-37564eebdfa4 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:46.913554 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235a30e-df9e-4a6f-bf4b-37564eebdfa4 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:46.919226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9800c-41e6-4c96-abed-9f6326ae5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:46.919901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9800c-41e6-4c96-abed-9f6326ae5be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:46.920235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9800c-41e6-4c96-abed-9f6326ae5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:46.920518 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9800c-41e6-4c96-abed-9f6326ae5be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:46.921250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9800c-41e6-4c96-abed-9f6326ae5be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:46.922851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9800c-41e6-4c96-abed-9f6326ae5be1 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:46.938613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1403/2793] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:53:46.942947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebd490-637f-4251-b608-a096862a0a65 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:46.953588 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebd490-637f-4251-b608-a096862a0a65 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:46.958242 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec006b1-9217-4c6e-9a71-00a26b611308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:46.959135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec006b1-9217-4c6e-9a71-00a26b611308 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:46.959425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec006b1-9217-4c6e-9a71-00a26b611308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:46.959702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec006b1-9217-4c6e-9a71-00a26b611308 admin admin] PATH_INFO: `/v3/projects/746e36f0b0a44e499bdaf10e4533f1e5/users/abac866e090f45bd88ebb6c81c1662e9/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:46.975442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec006b1-9217-4c6e-9a71-00a26b611308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746e36f0b0a44e499bdaf10e4533f1e5, user_id=abac866e090f45bd88ebb6c81c1662e9, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:46.978239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec006b1-9217-4c6e-9a71-00a26b611308 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:47.095803 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1391/2794] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:53:46 2022] PUT /identity/v3/projects/746e36f0b0a44e499bdaf10e4533f1e5/users/abac866e090f45bd88ebb6c81c1662e9/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:47.107164 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c132-8d47-498a-adda-1d3399a7f5ad None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:47.107449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c132-8d47-498a-adda-1d3399a7f5ad None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:47.107723 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c132-8d47-498a-adda-1d3399a7f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:47.139209 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3579c132-8d47-498a-adda-1d3399a7f5ad None None] MFA Rules not processed for user `abac866e090f45bd88ebb6c81c1662e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:47.140373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3579c132-8d47-498a-adda-1d3399a7f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:47.170590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:47.206251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1404/2795] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:47.210833 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec006b1-9217-4c6e-9a71-00a26b611308 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:47.279947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec006b1-9217-4c6e-9a71-00a26b611308 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:47.284895 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e3130-3c5c-4f55-a548-4ff9dfb92173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:47.285628 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e3130-3c5c-4f55-a548-4ff9dfb92173 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:47.285957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e3130-3c5c-4f55-a548-4ff9dfb92173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:47.286235 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e3130-3c5c-4f55-a548-4ff9dfb92173 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:47.286920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e3130-3c5c-4f55-a548-4ff9dfb92173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:47.288933 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e3130-3c5c-4f55-a548-4ff9dfb92173 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:47.405117 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:47.411671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1392/2796] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:53:47 2022] POST /identity/v3/projects => generated 403 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:53:47.421812 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579c132-8d47-498a-adda-1d3399a7f5ad None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:47.433747 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579c132-8d47-498a-adda-1d3399a7f5ad None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:47.495296 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c048aa-668a-432a-b5ed-340eeaea83ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:47.495891 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c048aa-668a-432a-b5ed-340eeaea83ab admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:47.496212 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c048aa-668a-432a-b5ed-340eeaea83ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:47.496492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c048aa-668a-432a-b5ed-340eeaea83ab admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:47.497178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c048aa-668a-432a-b5ed-340eeaea83ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:47.499091 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c048aa-668a-432a-b5ed-340eeaea83ab admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:47.610051 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1405/2797] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:53:47 2022] POST /identity/v3/users => generated 308 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:53:47.614569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e3130-3c5c-4f55-a548-4ff9dfb92173 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:47.625536 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e3130-3c5c-4f55-a548-4ff9dfb92173 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:47.630582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885ebcf-a5c8-4136-9a9a-715ede154005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:47.631260 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885ebcf-a5c8-4136-9a9a-715ede154005 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:47.631565 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885ebcf-a5c8-4136-9a9a-715ede154005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:47.631822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885ebcf-a5c8-4136-9a9a-715ede154005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:47.632589 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885ebcf-a5c8-4136-9a9a-715ede154005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:47.634194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885ebcf-a5c8-4136-9a9a-715ede154005 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:47.646351 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1393/2798] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:53:47.651709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c048aa-668a-432a-b5ed-340eeaea83ab admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:47.662075 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c048aa-668a-432a-b5ed-340eeaea83ab admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:47.666739 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f0d8-f004-416e-ba23-80fe347e378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:47.667629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f0d8-f004-416e-ba23-80fe347e378a admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:47.667910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f0d8-f004-416e-ba23-80fe347e378a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:47.668294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f0d8-f004-416e-ba23-80fe347e378a admin admin] PATH_INFO: `/v3/projects/f8109c7624844a66a2aeb05b442c3c46/users/986f510b07204c879d393e08473d7e96/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:47.684202 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5f0d8-f004-416e-ba23-80fe347e378a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8109c7624844a66a2aeb05b442c3c46, user_id=986f510b07204c879d393e08473d7e96, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:47.687129 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5f0d8-f004-416e-ba23-80fe347e378a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:47.804320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1406/2799] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:53:47 2022] PUT /identity/v3/projects/f8109c7624844a66a2aeb05b442c3c46/users/986f510b07204c879d393e08473d7e96/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:47.812988 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885ebcf-a5c8-4136-9a9a-715ede154005 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:47.823873 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885ebcf-a5c8-4136-9a9a-715ede154005 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:47.893182 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add281-2110-4b40-9645-6092879a74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:47.895851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add281-2110-4b40-9645-6092879a74c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:47.895851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add281-2110-4b40-9645-6092879a74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:47.895851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add281-2110-4b40-9645-6092879a74c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:47.895851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3add281-2110-4b40-9645-6092879a74c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:47.897225 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3add281-2110-4b40-9645-6092879a74c9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:47.909079 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1394/2800] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:53:47.913537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f0d8-f004-416e-ba23-80fe347e378a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:47.925194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f0d8-f004-416e-ba23-80fe347e378a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:47.930078 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0117-03fb-4cdb-9499-4cd4cebb8fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:47.930978 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0117-03fb-4cdb-9499-4cd4cebb8fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:47.931267 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0117-03fb-4cdb-9499-4cd4cebb8fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:47.931546 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0117-03fb-4cdb-9499-4cd4cebb8fcc admin admin] PATH_INFO: `/v3/projects/f8109c7624844a66a2aeb05b442c3c46/users/986f510b07204c879d393e08473d7e96/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:47.934225 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c0117-03fb-4cdb-9499-4cd4cebb8fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8109c7624844a66a2aeb05b442c3c46, user_id=986f510b07204c879d393e08473d7e96, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:47.937178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c0117-03fb-4cdb-9499-4cd4cebb8fcc admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:47.949651 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1407/2801] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:53:47 2022] PUT /identity/v3/projects/f8109c7624844a66a2aeb05b442c3c46/users/986f510b07204c879d393e08473d7e96/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:47.961127 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf504-e845-4162-af87-c8c7aab8728f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:47.961425 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf504-e845-4162-af87-c8c7aab8728f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:47.961724 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf504-e845-4162-af87-c8c7aab8728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:47.990794 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0bdbf504-e845-4162-af87-c8c7aab8728f None None] MFA Rules not processed for user `986f510b07204c879d393e08473d7e96`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:47.991663 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0bdbf504-e845-4162-af87-c8c7aab8728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:48.064814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1395/2802] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:53:48.076560 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0117-03fb-4cdb-9499-4cd4cebb8fcc admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:48.078293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-814c0117-03fb-4cdb-9499-4cd4cebb8fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:48.139093 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0117-03fb-4cdb-9499-4cd4cebb8fcc admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:48.142775 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961a5f7-c4e4-4362-8138-3fc511260ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:48.143428 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961a5f7-c4e4-4362-8138-3fc511260ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:48.143713 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961a5f7-c4e4-4362-8138-3fc511260ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:48.143990 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961a5f7-c4e4-4362-8138-3fc511260ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:48.153841 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961a5f7-c4e4-4362-8138-3fc511260ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:48.155290 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961a5f7-c4e4-4362-8138-3fc511260ec6 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:48.165311 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1408/2803] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:53:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:53:48.315939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf504-e845-4162-af87-c8c7aab8728f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:48.386739 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf504-e845-4162-af87-c8c7aab8728f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:48.391291 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:48.392489 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:48.392773 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:48.393048 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] PATH_INFO: `/v3/users/abac866e090f45bd88ebb6c81c1662e9` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:48.394248 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abac866e090f45bd88ebb6c81c1662e9)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:48.396213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:48.410753 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:48.646302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abac866e090f45bd88ebb6c81c1662e9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:48.661934 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abac866e090f45bd88ebb6c81c1662e9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:48.763669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abac866e090f45bd88ebb6c81c1662e9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:48.764331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abac866e090f45bd88ebb6c81c1662e9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:48.764989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abac866e090f45bd88ebb6c81c1662e9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:48.780165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1396/2804] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:53:48 2022] DELETE /identity/v3/users/abac866e090f45bd88ebb6c81c1662e9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:48.784937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79e02-a2c4-4193-b3ef-11e4d6d5531e None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:48.785537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79e02-a2c4-4193-b3ef-11e4d6d5531e None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:48.785537 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79e02-a2c4-4193-b3ef-11e4d6d5531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:48.806807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-eab79e02-a2c4-4193-b3ef-11e4d6d5531e None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:48.808265 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-eab79e02-a2c4-4193-b3ef-11e4d6d5531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:48.829937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:48.872246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1409/2805] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:48.882159 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:48.883903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:48.944687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df8adf-12b2-4e8a-88f0-a6f084528b81 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:48.948977 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a401d2e-a3b9-4e66-b50f-dbbc940139c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:48.949644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a401d2e-a3b9-4e66-b50f-dbbc940139c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:48.949922 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a401d2e-a3b9-4e66-b50f-dbbc940139c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:48.950197 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a401d2e-a3b9-4e66-b50f-dbbc940139c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:48.960213 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a401d2e-a3b9-4e66-b50f-dbbc940139c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:48.961779 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a401d2e-a3b9-4e66-b50f-dbbc940139c5 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:48.973930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1397/2806] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:53:49.507993 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab79e02-a2c4-4193-b3ef-11e4d6d5531e None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:49.510086 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-eab79e02-a2c4-4193-b3ef-11e4d6d5531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:49.525255 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab79e02-a2c4-4193-b3ef-11e4d6d5531e None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:49.530329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:49.531960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:49.532626 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:49.532912 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] PATH_INFO: `/v3/projects/746e36f0b0a44e499bdaf10e4533f1e5` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:49.534350 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746e36f0b0a44e499bdaf10e4533f1e5)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:49.538396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:49.645239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746e36f0b0a44e499bdaf10e4533f1e5', 'request_id': 'req-8b4f450c-488a-42e6-97cc-e38add9bf0f2'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:49.650941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746e36f0b0a44e499bdaf10e4533f1e5', 'request_id': 'req-8b4f450c-488a-42e6-97cc-e38add9bf0f2'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:49.657624 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746e36f0b0a44e499bdaf10e4533f1e5', 'request_id': 'req-8b4f450c-488a-42e6-97cc-e38add9bf0f2'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:49.782441 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] The token cache is being invalidate because project 746e36f0b0a44e499bdaf10e4533f1e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:53:49.782722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:49.783303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:49.784959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1410/2807] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:53:49 2022] DELETE /identity/v3/projects/746e36f0b0a44e499bdaf10e4533f1e5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:49.789350 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a401d2e-a3b9-4e66-b50f-dbbc940139c5 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:49.800220 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a401d2e-a3b9-4e66-b50f-dbbc940139c5 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:49.859488 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:49.860408 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:49.860687 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:49.860964 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] PATH_INFO: `/v3/users/986f510b07204c879d393e08473d7e96` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:49.862141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=986f510b07204c879d393e08473d7e96)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:49.864045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:50.083134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:50.094355 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986f510b07204c879d393e08473d7e96'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:50.106866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986f510b07204c879d393e08473d7e96'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:50.178116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986f510b07204c879d393e08473d7e96'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:50.178781 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986f510b07204c879d393e08473d7e96'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:50.179421 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bc92f403-7fee-4676-9519-1f10e5462a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986f510b07204c879d393e08473d7e96'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:50.194895 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1398/2808] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:53:49 2022] DELETE /identity/v3/users/986f510b07204c879d393e08473d7e96 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:50.651845 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:50.653359 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:50.667199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f450c-488a-42e6-97cc-e38add9bf0f2 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:50.736004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:50.736915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:50.737217 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:50.737477 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] PATH_INFO: `/v3/projects/f8109c7624844a66a2aeb05b442c3c46` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:50.738771 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8109c7624844a66a2aeb05b442c3c46)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:50.740878 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:50.908326 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8109c7624844a66a2aeb05b442c3c46', 'request_id': 'req-56bfebf5-557c-4fd4-884e-7bf93e842c7f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:50.910262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:50.915216 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8109c7624844a66a2aeb05b442c3c46', 'request_id': 'req-56bfebf5-557c-4fd4-884e-7bf93e842c7f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:50.922201 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8109c7624844a66a2aeb05b442c3c46', 'request_id': 'req-56bfebf5-557c-4fd4-884e-7bf93e842c7f'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:51.071991 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] The token cache is being invalidate because project f8109c7624844a66a2aeb05b442c3c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:53:51.072361 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:51.073675 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-56bfebf5-557c-4fd4-884e-7bf93e842c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:53:51.075293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1411/2809] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:53:50 2022] DELETE /identity/v3/projects/f8109c7624844a66a2aeb05b442c3c46 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:53:51.080318 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab351-96e3-4938-8f67-9cbc6a5dafbf None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:51.080639 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab351-96e3-4938-8f67-9cbc6a5dafbf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:51.080952 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab351-96e3-4938-8f67-9cbc6a5dafbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:51.100501 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c57ab351-96e3-4938-8f67-9cbc6a5dafbf None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:51.102063 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c57ab351-96e3-4938-8f67-9cbc6a5dafbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:51.168497 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1399/2810] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:51.176578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612cc3-8b20-4e41-8500-bd32198edec8 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:51.176864 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612cc3-8b20-4e41-8500-bd32198edec8 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:51.177097 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612cc3-8b20-4e41-8500-bd32198edec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:51.198122 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-87612cc3-8b20-4e41-8500-bd32198edec8 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:51.199367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-87612cc3-8b20-4e41-8500-bd32198edec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:51.207904 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1412/2811] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:51.219707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ab351-96e3-4938-8f67-9cbc6a5dafbf None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:51.229848 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ab351-96e3-4938-8f67-9cbc6a5dafbf None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:51.234554 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f22471-0edc-4184-9945-f7c5667d5d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:51.235247 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f22471-0edc-4184-9945-f7c5667d5d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:51.235525 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f22471-0edc-4184-9945-f7c5667d5d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:51.235797 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f22471-0edc-4184-9945-f7c5667d5d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:51.236560 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f22471-0edc-4184-9945-f7c5667d5d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:53:51.236865 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f22471-0edc-4184-9945-f7c5667d5d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:51.238446 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f22471-0edc-4184-9945-f7c5667d5d0b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:51.251052 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1400/2812] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:53:51.255658 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87612cc3-8b20-4e41-8500-bd32198edec8 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:51.266163 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87612cc3-8b20-4e41-8500-bd32198edec8 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:51.271052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698b79c-fc58-450d-a58b-1b436d55d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:51.271722 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698b79c-fc58-450d-a58b-1b436d55d2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:51.272004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698b79c-fc58-450d-a58b-1b436d55d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:51.272417 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698b79c-fc58-450d-a58b-1b436d55d2b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:51.273136 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698b79c-fc58-450d-a58b-1b436d55d2b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:51.275025 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698b79c-fc58-450d-a58b-1b436d55d2b7 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:51.363544 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1413/2813] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:53:51 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:53:51.368023 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f22471-0edc-4184-9945-f7c5667d5d0b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:51.379122 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f22471-0edc-4184-9945-f7c5667d5d0b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:51.437529 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38826833-184e-4026-8a93-e08f0b4b50a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:51.438203 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38826833-184e-4026-8a93-e08f0b4b50a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:51.438485 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38826833-184e-4026-8a93-e08f0b4b50a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:51.438759 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38826833-184e-4026-8a93-e08f0b4b50a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:51.439483 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38826833-184e-4026-8a93-e08f0b4b50a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:51.441429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38826833-184e-4026-8a93-e08f0b4b50a4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:51.533439 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1401/2814] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:53:51 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:53:51.537470 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698b79c-fc58-450d-a58b-1b436d55d2b7 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:51.549709 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698b79c-fc58-450d-a58b-1b436d55d2b7 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:51.554915 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a60e-0e2f-4dff-8007-54d2355a2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:51.555622 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a60e-0e2f-4dff-8007-54d2355a2079 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:51.555901 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a60e-0e2f-4dff-8007-54d2355a2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:51.556375 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a60e-0e2f-4dff-8007-54d2355a2079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:51.558166 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6a60e-0e2f-4dff-8007-54d2355a2079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:51.559851 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6a60e-0e2f-4dff-8007-54d2355a2079 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:51.572487 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1414/2815] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:53:51.577254 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38826833-184e-4026-8a93-e08f0b4b50a4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:51.587524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38826833-184e-4026-8a93-e08f0b4b50a4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:51.592338 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613207d-7a1e-4555-a5a1-296bfbe5cdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:51.593013 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613207d-7a1e-4555-a5a1-296bfbe5cdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:51.593299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613207d-7a1e-4555-a5a1-296bfbe5cdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:51.593578 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613207d-7a1e-4555-a5a1-296bfbe5cdf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:51.594302 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613207d-7a1e-4555-a5a1-296bfbe5cdf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:51.595920 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613207d-7a1e-4555-a5a1-296bfbe5cdf8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:51.608109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1402/2816] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:53:51.612396 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a60e-0e2f-4dff-8007-54d2355a2079 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:51.624066 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a60e-0e2f-4dff-8007-54d2355a2079 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:51.628920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d753-52f5-44f4-9f17-d81bfc412c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:51.629843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d753-52f5-44f4-9f17-d81bfc412c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:51.630145 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d753-52f5-44f4-9f17-d81bfc412c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:51.630406 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d753-52f5-44f4-9f17-d81bfc412c2e admin admin] PATH_INFO: `/v3/projects/eec619ccff1449deb9c805846354e862/users/ab3a6071306d48f68e792063e1a752ae/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:51.646586 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5d753-52f5-44f4-9f17-d81bfc412c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec619ccff1449deb9c805846354e862, user_id=ab3a6071306d48f68e792063e1a752ae, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:51.649274 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5d753-52f5-44f4-9f17-d81bfc412c2e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:51.723802 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1415/2817] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:53:51 2022] PUT /identity/v3/projects/eec619ccff1449deb9c805846354e862/users/ab3a6071306d48f68e792063e1a752ae/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:51.736562 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c51ec-0a2d-48bf-87ba-ae3d243d0c02 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:51.736856 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c51ec-0a2d-48bf-87ba-ae3d243d0c02 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:51.737137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c51ec-0a2d-48bf-87ba-ae3d243d0c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:51.764745 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-af2c51ec-0a2d-48bf-87ba-ae3d243d0c02 None None] MFA Rules not processed for user `ab3a6071306d48f68e792063e1a752ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:51.765965 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-af2c51ec-0a2d-48bf-87ba-ae3d243d0c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:51.771082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:51.838650 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1403/2818] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:51.843299 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d753-52f5-44f4-9f17-d81bfc412c2e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:51.909770 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d753-52f5-44f4-9f17-d81bfc412c2e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:51.914602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a858bd7-30dc-464c-b3fc-fde59f6bb3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:51.915277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a858bd7-30dc-464c-b3fc-fde59f6bb3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:51.915570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a858bd7-30dc-464c-b3fc-fde59f6bb3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:51.915854 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a858bd7-30dc-464c-b3fc-fde59f6bb3e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:51.917178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a858bd7-30dc-464c-b3fc-fde59f6bb3e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:51.919083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a858bd7-30dc-464c-b3fc-fde59f6bb3e8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:52.005002 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1416/2819] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:53:51 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:53:52.009056 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c51ec-0a2d-48bf-87ba-ae3d243d0c02 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:52.021171 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c51ec-0a2d-48bf-87ba-ae3d243d0c02 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:52.081617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1278904-cbce-4dfc-a8cc-422baaa78127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:52.082320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1278904-cbce-4dfc-a8cc-422baaa78127 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:52.082608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1278904-cbce-4dfc-a8cc-422baaa78127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:52.082890 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1278904-cbce-4dfc-a8cc-422baaa78127 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:52.083595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1278904-cbce-4dfc-a8cc-422baaa78127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:52.085582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1278904-cbce-4dfc-a8cc-422baaa78127 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:52.255422 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1404/2820] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:53:52 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:53:52.259409 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a858bd7-30dc-464c-b3fc-fde59f6bb3e8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:52.270434 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a858bd7-30dc-464c-b3fc-fde59f6bb3e8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:52.277858 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602767c0-edb5-47c9-a81d-180f11088184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:52.278549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602767c0-edb5-47c9-a81d-180f11088184 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:52.278835 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602767c0-edb5-47c9-a81d-180f11088184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:52.279138 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602767c0-edb5-47c9-a81d-180f11088184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:52.279879 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602767c0-edb5-47c9-a81d-180f11088184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:52.281526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602767c0-edb5-47c9-a81d-180f11088184 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:52.293547 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1417/2821] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:53:52.302808 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1278904-cbce-4dfc-a8cc-422baaa78127 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:52.314647 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1278904-cbce-4dfc-a8cc-422baaa78127 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:52.319614 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ee71a-bf20-452d-b0a9-c8193237d5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:52.320566 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ee71a-bf20-452d-b0a9-c8193237d5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:52.320851 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ee71a-bf20-452d-b0a9-c8193237d5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:52.321130 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ee71a-bf20-452d-b0a9-c8193237d5ea admin admin] PATH_INFO: `/v3/projects/40c08fde070a4a77a349da235f55b63c/users/bdb4463188ec494ab2d4cc288b6968ad/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:52.340440 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ee71a-bf20-452d-b0a9-c8193237d5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c08fde070a4a77a349da235f55b63c, user_id=bdb4463188ec494ab2d4cc288b6968ad, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:52.343145 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ee71a-bf20-452d-b0a9-c8193237d5ea admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:52.431085 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1405/2822] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:53:52 2022] PUT /identity/v3/projects/40c08fde070a4a77a349da235f55b63c/users/bdb4463188ec494ab2d4cc288b6968ad/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:52.436907 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602767c0-edb5-47c9-a81d-180f11088184 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:52.447178 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602767c0-edb5-47c9-a81d-180f11088184 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:52.498095 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:53:52.507684 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b4c28-a2c7-41fe-8d35-b51a6d5a2a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:52.508468 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b4c28-a2c7-41fe-8d35-b51a6d5a2a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:52.508753 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b4c28-a2c7-41fe-8d35-b51a6d5a2a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:52.509102 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b4c28-a2c7-41fe-8d35-b51a6d5a2a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:52.509749 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b4c28-a2c7-41fe-8d35-b51a6d5a2a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:52.511995 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b4c28-a2c7-41fe-8d35-b51a6d5a2a7a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:52.522613 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1418/2823] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:53:52.526812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ee71a-bf20-452d-b0a9-c8193237d5ea admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:52.537649 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ee71a-bf20-452d-b0a9-c8193237d5ea admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:52.542568 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3b840-fdde-4dc7-927c-8936ade5cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:52.543538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3b840-fdde-4dc7-927c-8936ade5cb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:52.543815 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3b840-fdde-4dc7-927c-8936ade5cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:52.544114 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3b840-fdde-4dc7-927c-8936ade5cb4f admin admin] PATH_INFO: `/v3/projects/40c08fde070a4a77a349da235f55b63c/users/bdb4463188ec494ab2d4cc288b6968ad/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:52.546369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3b840-fdde-4dc7-927c-8936ade5cb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c08fde070a4a77a349da235f55b63c, user_id=bdb4463188ec494ab2d4cc288b6968ad, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:52.548802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3b840-fdde-4dc7-927c-8936ade5cb4f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:52.560482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1406/2824] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:53:52 2022] PUT /identity/v3/projects/40c08fde070a4a77a349da235f55b63c/users/bdb4463188ec494ab2d4cc288b6968ad/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:53:52.570762 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213d8a-3b1a-4c45-a064-634d8aa72e1d None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:52.571055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213d8a-3b1a-4c45-a064-634d8aa72e1d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:52.571329 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213d8a-3b1a-4c45-a064-634d8aa72e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:52.603996 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-a1213d8a-3b1a-4c45-a064-634d8aa72e1d None None] MFA Rules not processed for user `bdb4463188ec494ab2d4cc288b6968ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:53:52.605705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-a1213d8a-3b1a-4c45-a064-634d8aa72e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:52.677710 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1419/2825] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:53:52 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:53:52.691244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3b840-fdde-4dc7-927c-8936ade5cb4f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:52.693090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d7b3b840-fdde-4dc7-927c-8936ade5cb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:53:52.754947 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3b840-fdde-4dc7-927c-8936ade5cb4f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:52.759727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26228ef-630a-4b54-a627-f410c785b87b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:52.761164 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26228ef-630a-4b54-a627-f410c785b87b service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:52.761504 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26228ef-630a-4b54-a627-f410c785b87b service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:52.761782 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26228ef-630a-4b54-a627-f410c785b87b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:52.771617 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26228ef-630a-4b54-a627-f410c785b87b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:52.773111 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26228ef-630a-4b54-a627-f410c785b87b service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:52.783822 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1407/2826] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:53:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:53:53.090756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1213d8a-3b1a-4c45-a064-634d8aa72e1d None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:53:53.100807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1213d8a-3b1a-4c45-a064-634d8aa72e1d None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:53:53.104621 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de2a92-d8db-461c-ab77-c8cb91b1fed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:53:53.105456 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de2a92-d8db-461c-ab77-c8cb91b1fed4 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:53:53.105734 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de2a92-d8db-461c-ab77-c8cb91b1fed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:53:53.106015 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de2a92-d8db-461c-ab77-c8cb91b1fed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:53:53.169028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de2a92-d8db-461c-ab77-c8cb91b1fed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:53:53.170482 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de2a92-d8db-461c-ab77-c8cb91b1fed4 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:53:53.180360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1420/2827] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:53:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:54:02.779259 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:03.175805 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=68 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:32.907959 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26228ef-630a-4b54-a627-f410c785b87b service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:32.972493 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26228ef-630a-4b54-a627-f410c785b87b service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:32.977090 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:32.977984 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:32.978265 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:32.978538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] PATH_INFO: `/v3/users/ab3a6071306d48f68e792063e1a752ae` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:32.981516 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3a6071306d48f68e792063e1a752ae)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:32.983441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:33.179239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3a6071306d48f68e792063e1a752ae'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:33.191842 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3a6071306d48f68e792063e1a752ae'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:33.273771 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3a6071306d48f68e792063e1a752ae'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:33.274424 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3a6071306d48f68e792063e1a752ae'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:33.275041 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3a6071306d48f68e792063e1a752ae'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:33.289519 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1408/2828] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:54:32 2022] DELETE /identity/v3/users/ab3a6071306d48f68e792063e1a752ae => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:33.294357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430d03c-fbbb-4be5-aec0-54830581a463 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:33.294976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430d03c-fbbb-4be5-aec0-54830581a463 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:33.294976 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430d03c-fbbb-4be5-aec0-54830581a463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:33.312949 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d430d03c-fbbb-4be5-aec0-54830581a463 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:33.314190 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d430d03c-fbbb-4be5-aec0-54830581a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:33.377306 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1421/2829] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:33.388110 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:33.389680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:33.449744 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bd906-6987-4060-8c86-59fc2aff002d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:33.453460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30ba0-e4c4-4a6e-a713-624893b5579b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:33.454116 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30ba0-e4c4-4a6e-a713-624893b5579b service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:33.454398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30ba0-e4c4-4a6e-a713-624893b5579b service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:33.454673 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30ba0-e4c4-4a6e-a713-624893b5579b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:33.464701 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e30ba0-e4c4-4a6e-a713-624893b5579b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:33.466141 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e30ba0-e4c4-4a6e-a713-624893b5579b service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:33.476300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1409/2830] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:54:33.958351 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430d03c-fbbb-4be5-aec0-54830581a463 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:33.959982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d430d03c-fbbb-4be5-aec0-54830581a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:33.972470 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430d03c-fbbb-4be5-aec0-54830581a463 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:33.977336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:33.978236 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:33.978532 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:33.978997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] PATH_INFO: `/v3/projects/eec619ccff1449deb9c805846354e862` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:33.983246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec619ccff1449deb9c805846354e862)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:33.985258 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:34.096367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec619ccff1449deb9c805846354e862', 'request_id': 'req-072735b4-8cc5-4f20-808a-6e78dc2b0761'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:34.102174 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec619ccff1449deb9c805846354e862', 'request_id': 'req-072735b4-8cc5-4f20-808a-6e78dc2b0761'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:34.109338 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec619ccff1449deb9c805846354e862', 'request_id': 'req-072735b4-8cc5-4f20-808a-6e78dc2b0761'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:34.162289 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] The token cache is being invalidate because project eec619ccff1449deb9c805846354e862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:54:34.162602 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:34.163247 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:34.164836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1422/2831] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:54:33 2022] DELETE /identity/v3/projects/eec619ccff1449deb9c805846354e862 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:34.169082 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30ba0-e4c4-4a6e-a713-624893b5579b service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:34.179160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30ba0-e4c4-4a6e-a713-624893b5579b service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:34.200205 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:34.240250 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906946a0-6983-439d-9c86-633392295587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:34.241037 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906946a0-6983-439d-9c86-633392295587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:34.241317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906946a0-6983-439d-9c86-633392295587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:34.241590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906946a0-6983-439d-9c86-633392295587 admin admin] PATH_INFO: `/v3/users/bdb4463188ec494ab2d4cc288b6968ad` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:34.242793 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906946a0-6983-439d-9c86-633392295587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb4463188ec494ab2d4cc288b6968ad)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:34.245331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906946a0-6983-439d-9c86-633392295587 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:34.468608 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-906946a0-6983-439d-9c86-633392295587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb4463188ec494ab2d4cc288b6968ad'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:34.481802 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-906946a0-6983-439d-9c86-633392295587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb4463188ec494ab2d4cc288b6968ad'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:34.579586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-906946a0-6983-439d-9c86-633392295587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb4463188ec494ab2d4cc288b6968ad'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:34.580273 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-906946a0-6983-439d-9c86-633392295587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb4463188ec494ab2d4cc288b6968ad'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:34.580911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-906946a0-6983-439d-9c86-633392295587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb4463188ec494ab2d4cc288b6968ad'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:34.595270 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1410/2832] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:54:34 2022] DELETE /identity/v3/users/bdb4463188ec494ab2d4cc288b6968ad => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:35.088126 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:35.090298 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:35.106087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072735b4-8cc5-4f20-808a-6e78dc2b0761 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:35.169863 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:35.170767 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:35.171055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:35.171335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] PATH_INFO: `/v3/projects/40c08fde070a4a77a349da235f55b63c` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:35.172582 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c08fde070a4a77a349da235f55b63c)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:35.174549 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:35.295818 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:35.313082 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c08fde070a4a77a349da235f55b63c', 'request_id': 'req-599f1ce1-4ea8-45f7-a533-63a9d111c96a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:35.318628 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c08fde070a4a77a349da235f55b63c', 'request_id': 'req-599f1ce1-4ea8-45f7-a533-63a9d111c96a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:35.324987 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c08fde070a4a77a349da235f55b63c', 'request_id': 'req-599f1ce1-4ea8-45f7-a533-63a9d111c96a'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:35.463223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] The token cache is being invalidate because project 40c08fde070a4a77a349da235f55b63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:54:35.463610 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:35.464464 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-599f1ce1-4ea8-45f7-a533-63a9d111c96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:35.466473 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1423/2833] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:54:35 2022] DELETE /identity/v3/projects/40c08fde070a4a77a349da235f55b63c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:35.471957 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bb5df-5ea2-47ea-a269-ffb889dba680 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:35.472561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bb5df-5ea2-47ea-a269-ffb889dba680 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:35.472561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bb5df-5ea2-47ea-a269-ffb889dba680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:35.492157 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-481bb5df-5ea2-47ea-a269-ffb889dba680 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:35.496604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-481bb5df-5ea2-47ea-a269-ffb889dba680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:35.554345 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1411/2834] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:35.563348 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37901b-fafc-45da-bde7-6fddee4e04b7 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:35.563783 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37901b-fafc-45da-bde7-6fddee4e04b7 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:35.564089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37901b-fafc-45da-bde7-6fddee4e04b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:35.584985 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-4a37901b-fafc-45da-bde7-6fddee4e04b7 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:35.586241 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-4a37901b-fafc-45da-bde7-6fddee4e04b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:35.595568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1424/2835] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:35.599867 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bb5df-5ea2-47ea-a269-ffb889dba680 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:35.610766 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bb5df-5ea2-47ea-a269-ffb889dba680 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:35.615334 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6524a5-e3ba-4dce-9014-d3587528fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:35.615995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6524a5-e3ba-4dce-9014-d3587528fa36 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:35.616303 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6524a5-e3ba-4dce-9014-d3587528fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:35.616582 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6524a5-e3ba-4dce-9014-d3587528fa36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:35.617304 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6524a5-e3ba-4dce-9014-d3587528fa36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:54:35.617611 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6524a5-e3ba-4dce-9014-d3587528fa36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:35.619204 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6524a5-e3ba-4dce-9014-d3587528fa36 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:35.631109 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1412/2836] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:54:35.635394 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37901b-fafc-45da-bde7-6fddee4e04b7 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:35.644828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37901b-fafc-45da-bde7-6fddee4e04b7 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:35.650251 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d63b0c-1530-49dc-ae81-2188e3144d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:35.650834 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d63b0c-1530-49dc-ae81-2188e3144d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:35.651662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d63b0c-1530-49dc-ae81-2188e3144d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:35.651994 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d63b0c-1530-49dc-ae81-2188e3144d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:35.652705 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d63b0c-1530-49dc-ae81-2188e3144d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:35.654581 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d63b0c-1530-49dc-ae81-2188e3144d7f admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:35.778981 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1425/2837] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:54:35 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:35.782944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6524a5-e3ba-4dce-9014-d3587528fa36 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:35.794463 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6524a5-e3ba-4dce-9014-d3587528fa36 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:35.821044 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:35.853279 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d94b-f43c-446c-9fae-4ee1056d7c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:35.853959 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d94b-f43c-446c-9fae-4ee1056d7c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:35.855066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d94b-f43c-446c-9fae-4ee1056d7c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:35.855677 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d94b-f43c-446c-9fae-4ee1056d7c21 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:35.856447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d94b-f43c-446c-9fae-4ee1056d7c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:35.860183 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d94b-f43c-446c-9fae-4ee1056d7c21 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:35.982785 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1413/2838] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:54:35 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:35.987169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d63b0c-1530-49dc-ae81-2188e3144d7f admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:35.998503 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d63b0c-1530-49dc-ae81-2188e3144d7f admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:36.003099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee69ec-0091-4997-a7ae-f482f2ebb5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:36.003850 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee69ec-0091-4997-a7ae-f482f2ebb5df admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.004175 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee69ec-0091-4997-a7ae-f482f2ebb5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.004458 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee69ec-0091-4997-a7ae-f482f2ebb5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.005210 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee69ec-0091-4997-a7ae-f482f2ebb5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:36.006816 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee69ec-0091-4997-a7ae-f482f2ebb5df admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:36.021288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1426/2839] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:54:36.025407 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d94b-f43c-446c-9fae-4ee1056d7c21 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:36.036367 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d94b-f43c-446c-9fae-4ee1056d7c21 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:36.041034 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f9c6-df51-4e9d-90f1-bc7540cf6924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:36.042884 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f9c6-df51-4e9d-90f1-bc7540cf6924 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.043177 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f9c6-df51-4e9d-90f1-bc7540cf6924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.043527 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f9c6-df51-4e9d-90f1-bc7540cf6924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.044317 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838f9c6-df51-4e9d-90f1-bc7540cf6924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:36.045911 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838f9c6-df51-4e9d-90f1-bc7540cf6924 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:36.056878 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1414/2840] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:36.061758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee69ec-0091-4997-a7ae-f482f2ebb5df admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:36.071678 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee69ec-0091-4997-a7ae-f482f2ebb5df admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:36.076883 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a361423-b385-4d8a-91df-b444d79e4cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:36.077758 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361423-b385-4d8a-91df-b444d79e4cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.078068 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361423-b385-4d8a-91df-b444d79e4cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.078346 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361423-b385-4d8a-91df-b444d79e4cb3 admin admin] PATH_INFO: `/v3/projects/ce8b85f681cf45a59b1b4c97330035ef/users/86c39badc7924ed0a256efa884623bab/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.093500 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a361423-b385-4d8a-91df-b444d79e4cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8b85f681cf45a59b1b4c97330035ef, user_id=86c39badc7924ed0a256efa884623bab, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:36.096233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a361423-b385-4d8a-91df-b444d79e4cb3 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:36.176631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1427/2841] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:54:36 2022] PUT /identity/v3/projects/ce8b85f681cf45a59b1b4c97330035ef/users/86c39badc7924ed0a256efa884623bab/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:36.187723 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b8d56-1f6f-472c-a1d9-164bdded02fe None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.191276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b8d56-1f6f-472c-a1d9-164bdded02fe None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.191276 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b8d56-1f6f-472c-a1d9-164bdded02fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.215522 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d56b8d56-1f6f-472c-a1d9-164bdded02fe None None] MFA Rules not processed for user `86c39badc7924ed0a256efa884623bab`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:36.216827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d56b8d56-1f6f-472c-a1d9-164bdded02fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:36.283748 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1415/2842] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:36.288467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a361423-b385-4d8a-91df-b444d79e4cb3 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:36.350726 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a361423-b385-4d8a-91df-b444d79e4cb3 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:36.356304 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c1c98-e4e3-4771-a6e3-43bcb566e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:36.356965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c1c98-e4e3-4771-a6e3-43bcb566e695 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.357249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c1c98-e4e3-4771-a6e3-43bcb566e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.357529 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c1c98-e4e3-4771-a6e3-43bcb566e695 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.358199 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c1c98-e4e3-4771-a6e3-43bcb566e695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:36.360099 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c1c98-e4e3-4771-a6e3-43bcb566e695 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:36.447597 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1428/2843] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:54:36 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:36.452460 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b8d56-1f6f-472c-a1d9-164bdded02fe None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:36.464755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b8d56-1f6f-472c-a1d9-164bdded02fe None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:36.524768 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3268d1-603f-44f2-b9da-ff7d7e15f3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:36.525464 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3268d1-603f-44f2-b9da-ff7d7e15f3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.525750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3268d1-603f-44f2-b9da-ff7d7e15f3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.526573 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3268d1-603f-44f2-b9da-ff7d7e15f3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.527830 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3268d1-603f-44f2-b9da-ff7d7e15f3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:36.529865 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3268d1-603f-44f2-b9da-ff7d7e15f3e3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:36.611877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1416/2844] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:54:36 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:36.615956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c1c98-e4e3-4771-a6e3-43bcb566e695 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:36.627496 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c1c98-e4e3-4771-a6e3-43bcb566e695 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:36.632391 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7e7d5-ea13-4fb3-9241-1fe008178569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:36.633080 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7e7d5-ea13-4fb3-9241-1fe008178569 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.633367 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7e7d5-ea13-4fb3-9241-1fe008178569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.633672 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7e7d5-ea13-4fb3-9241-1fe008178569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.634443 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7e7d5-ea13-4fb3-9241-1fe008178569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:36.637232 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7e7d5-ea13-4fb3-9241-1fe008178569 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:36.648789 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1429/2845] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:36.653707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3268d1-603f-44f2-b9da-ff7d7e15f3e3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:36.664195 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3268d1-603f-44f2-b9da-ff7d7e15f3e3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:36.668901 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20971d-f272-46ca-a18f-8cafa08e2a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:36.669792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20971d-f272-46ca-a18f-8cafa08e2a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.670078 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20971d-f272-46ca-a18f-8cafa08e2a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.670353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20971d-f272-46ca-a18f-8cafa08e2a56 admin admin] PATH_INFO: `/v3/projects/60b1f3a68b9545cb80bf9a074e95ba3c/users/b6ec1ccfb183405a8c1529a7078f8e65/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.686555 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20971d-f272-46ca-a18f-8cafa08e2a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b1f3a68b9545cb80bf9a074e95ba3c, user_id=b6ec1ccfb183405a8c1529a7078f8e65, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:36.689316 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20971d-f272-46ca-a18f-8cafa08e2a56 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:36.791995 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1417/2846] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:54:36 2022] PUT /identity/v3/projects/60b1f3a68b9545cb80bf9a074e95ba3c/users/b6ec1ccfb183405a8c1529a7078f8e65/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:36.796421 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7e7d5-ea13-4fb3-9241-1fe008178569 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:36.806830 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7e7d5-ea13-4fb3-9241-1fe008178569 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:36.828732 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:36.865911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6d29c-5772-4e5c-9df4-286ac71b7fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:36.866601 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6d29c-5772-4e5c-9df4-286ac71b7fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.866892 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6d29c-5772-4e5c-9df4-286ac71b7fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.867172 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6d29c-5772-4e5c-9df4-286ac71b7fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.867921 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6d29c-5772-4e5c-9df4-286ac71b7fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:36.869566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6d29c-5772-4e5c-9df4-286ac71b7fe4 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:36.881087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1430/2847] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:36.885227 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20971d-f272-46ca-a18f-8cafa08e2a56 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:36.891777 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:36.897168 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20971d-f272-46ca-a18f-8cafa08e2a56 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:36.902538 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830282-ca0a-43a3-8e1b-ea4951b00110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:36.903420 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830282-ca0a-43a3-8e1b-ea4951b00110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.903702 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830282-ca0a-43a3-8e1b-ea4951b00110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.903976 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830282-ca0a-43a3-8e1b-ea4951b00110 admin admin] PATH_INFO: `/v3/projects/60b1f3a68b9545cb80bf9a074e95ba3c/users/b6ec1ccfb183405a8c1529a7078f8e65/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.905980 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830282-ca0a-43a3-8e1b-ea4951b00110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b1f3a68b9545cb80bf9a074e95ba3c, user_id=b6ec1ccfb183405a8c1529a7078f8e65, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:36.908685 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830282-ca0a-43a3-8e1b-ea4951b00110 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:36.919045 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1418/2848] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:54:36 2022] PUT /identity/v3/projects/60b1f3a68b9545cb80bf9a074e95ba3c/users/b6ec1ccfb183405a8c1529a7078f8e65/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:36.929780 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fdb12-0563-4d31-b573-af0e3cd90e63 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:36.930074 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fdb12-0563-4d31-b573-af0e3cd90e63 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:36.930353 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fdb12-0563-4d31-b573-af0e3cd90e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:36.958828 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-3f1fdb12-0563-4d31-b573-af0e3cd90e63 None None] MFA Rules not processed for user `b6ec1ccfb183405a8c1529a7078f8e65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:36.960057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-3f1fdb12-0563-4d31-b573-af0e3cd90e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:37.036605 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1431/2849] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:37.048019 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830282-ca0a-43a3-8e1b-ea4951b00110 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:37.049787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3c830282-ca0a-43a3-8e1b-ea4951b00110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:37.109804 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830282-ca0a-43a3-8e1b-ea4951b00110 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:37.114361 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca8776-8acf-4ce3-812f-2d8cd6981d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:37.115014 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca8776-8acf-4ce3-812f-2d8cd6981d8c service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:37.115299 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca8776-8acf-4ce3-812f-2d8cd6981d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:37.115577 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca8776-8acf-4ce3-812f-2d8cd6981d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:37.125315 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca8776-8acf-4ce3-812f-2d8cd6981d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:37.126755 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca8776-8acf-4ce3-812f-2d8cd6981d8c service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:37.136722 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1419/2850] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:54:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:54:38.174294 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fdb12-0563-4d31-b573-af0e3cd90e63 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:38.238455 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fdb12-0563-4d31-b573-af0e3cd90e63 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:38.243056 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:38.243937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:38.244261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:38.244540 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] PATH_INFO: `/v3/users/86c39badc7924ed0a256efa884623bab` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:38.246786 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c39badc7924ed0a256efa884623bab)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:38.248785 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:38.472946 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c39badc7924ed0a256efa884623bab'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:38.474060 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:38.485936 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c39badc7924ed0a256efa884623bab'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:38.559744 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c39badc7924ed0a256efa884623bab'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:38.560398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c39badc7924ed0a256efa884623bab'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:38.561028 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c39badc7924ed0a256efa884623bab'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:38.574688 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1432/2851] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:54:38 2022] DELETE /identity/v3/users/86c39badc7924ed0a256efa884623bab => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:38.579281 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fb383-0e87-4922-9215-c42cf5c6ac1b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:38.579756 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fb383-0e87-4922-9215-c42cf5c6ac1b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:38.579879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fb383-0e87-4922-9215-c42cf5c6ac1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:38.598142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-4b1fb383-0e87-4922-9215-c42cf5c6ac1b None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:38.599482 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4b1fb383-0e87-4922-9215-c42cf5c6ac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:38.659442 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1420/2852] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:38.669814 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:38.671252 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:38.728501 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa711413-113b-4234-a880-90acade27b39 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:38.732941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2084c-736c-4f65-b45d-08bf8cd3c7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:38.733603 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2084c-736c-4f65-b45d-08bf8cd3c7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:38.733889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2084c-736c-4f65-b45d-08bf8cd3c7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:38.734168 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2084c-736c-4f65-b45d-08bf8cd3c7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:38.743639 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2084c-736c-4f65-b45d-08bf8cd3c7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:38.745242 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2084c-736c-4f65-b45d-08bf8cd3c7e3 service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:38.754821 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1433/2853] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:54:39.243953 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fb383-0e87-4922-9215-c42cf5c6ac1b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:39.245960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4b1fb383-0e87-4922-9215-c42cf5c6ac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:39.261331 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fb383-0e87-4922-9215-c42cf5c6ac1b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:39.266071 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:39.266973 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:39.267328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:39.267661 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] PATH_INFO: `/v3/projects/ce8b85f681cf45a59b1b4c97330035ef` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:39.268917 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8b85f681cf45a59b1b4c97330035ef)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:39.277223 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:39.418465 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8b85f681cf45a59b1b4c97330035ef', 'request_id': 'req-5ad96be7-912c-47bd-ae1d-36fb41fa3249'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:39.423983 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8b85f681cf45a59b1b4c97330035ef', 'request_id': 'req-5ad96be7-912c-47bd-ae1d-36fb41fa3249'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:39.522163 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8b85f681cf45a59b1b4c97330035ef', 'request_id': 'req-5ad96be7-912c-47bd-ae1d-36fb41fa3249'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:39.535142 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] The token cache is being invalidate because project ce8b85f681cf45a59b1b4c97330035ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:54:39.535415 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:39.536098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:39.537827 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1421/2854] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:54:39 2022] DELETE /identity/v3/projects/ce8b85f681cf45a59b1b4c97330035ef => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:39.542137 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2084c-736c-4f65-b45d-08bf8cd3c7e3 service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:39.552233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2084c-736c-4f65-b45d-08bf8cd3c7e3 service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:39.613382 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:39.614270 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:39.614558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:39.614843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] PATH_INFO: `/v3/users/b6ec1ccfb183405a8c1529a7078f8e65` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:39.616055 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ec1ccfb183405a8c1529a7078f8e65)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:39.618076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:39.819558 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ec1ccfb183405a8c1529a7078f8e65'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:39.831759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ec1ccfb183405a8c1529a7078f8e65'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:39.835594 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:39.896540 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ec1ccfb183405a8c1529a7078f8e65'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:39.897169 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ec1ccfb183405a8c1529a7078f8e65'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:39.897793 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0030a3f0-178c-4367-bad7-c34acd581ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ec1ccfb183405a8c1529a7078f8e65'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:39.912546 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1434/2855] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:54:39 2022] DELETE /identity/v3/users/b6ec1ccfb183405a8c1529a7078f8e65 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:40.375366 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:40.376866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:40.392357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad96be7-912c-47bd-ae1d-36fb41fa3249 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:40.406937 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:40.456727 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:40.457602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:40.458061 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:40.458342 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] PATH_INFO: `/v3/projects/60b1f3a68b9545cb80bf9a074e95ba3c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:40.459519 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b1f3a68b9545cb80bf9a074e95ba3c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:40.461455 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:40.557623 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b1f3a68b9545cb80bf9a074e95ba3c', 'request_id': 'req-a05c253d-ac93-4543-8f55-15536703ad4c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:40.563945 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b1f3a68b9545cb80bf9a074e95ba3c', 'request_id': 'req-a05c253d-ac93-4543-8f55-15536703ad4c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:40.682272 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b1f3a68b9545cb80bf9a074e95ba3c', 'request_id': 'req-a05c253d-ac93-4543-8f55-15536703ad4c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:40.694692 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] The token cache is being invalidate because project 60b1f3a68b9545cb80bf9a074e95ba3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:54:40.694982 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:40.695674 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a05c253d-ac93-4543-8f55-15536703ad4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:40.697253 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1422/2856] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:54:40 2022] DELETE /identity/v3/projects/60b1f3a68b9545cb80bf9a074e95ba3c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:54:40.702954 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6101-3394-4e1d-b5b4-7257b99085b2 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:40.703419 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6101-3394-4e1d-b5b4-7257b99085b2 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:40.703583 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6101-3394-4e1d-b5b4-7257b99085b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:40.722268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-d8eb6101-3394-4e1d-b5b4-7257b99085b2 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:40.723527 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-d8eb6101-3394-4e1d-b5b4-7257b99085b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:40.793834 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1435/2857] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:40.802801 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3376b8-d112-494a-99d3-a4de1c3a5ae4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:40.803098 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3376b8-d112-494a-99d3-a4de1c3a5ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:40.803374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3376b8-d112-494a-99d3-a4de1c3a5ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:40.823767 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2d3376b8-d112-494a-99d3-a4de1c3a5ae4 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:40.825197 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2d3376b8-d112-494a-99d3-a4de1c3a5ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:40.833375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1423/2858] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:40.837689 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6101-3394-4e1d-b5b4-7257b99085b2 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:40.847796 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6101-3394-4e1d-b5b4-7257b99085b2 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:40.852574 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df7608-d97e-46c7-9d52-7a84b1910769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:40.853250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7608-d97e-46c7-9d52-7a84b1910769 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:40.853538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7608-d97e-46c7-9d52-7a84b1910769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:40.853949 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7608-d97e-46c7-9d52-7a84b1910769 admin admin] PATH_INFO: `/v3/domains` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:40.854743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df7608-d97e-46c7-9d52-7a84b1910769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80456) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:54:40.855057 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df7608-d97e-46c7-9d52-7a84b1910769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:40.856715 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df7608-d97e-46c7-9d52-7a84b1910769 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:40.869173 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1436/2859] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:54:40.874071 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3376b8-d112-494a-99d3-a4de1c3a5ae4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:40.883719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3376b8-d112-494a-99d3-a4de1c3a5ae4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:40.889398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37402b-8bc6-4e51-aed9-57b09aa989b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:40.890071 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37402b-8bc6-4e51-aed9-57b09aa989b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:40.890358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37402b-8bc6-4e51-aed9-57b09aa989b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:40.890638 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37402b-8bc6-4e51-aed9-57b09aa989b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:40.891336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37402b-8bc6-4e51-aed9-57b09aa989b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:40.893309 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37402b-8bc6-4e51-aed9-57b09aa989b6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:40.978449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1424/2860] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:54:40 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:40.982759 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df7608-d97e-46c7-9d52-7a84b1910769 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:40.993027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df7608-d97e-46c7-9d52-7a84b1910769 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:41.052261 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c620-bfa7-41b7-9ea9-dc6633a3cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:41.052935 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c620-bfa7-41b7-9ea9-dc6633a3cf90 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:41.053223 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c620-bfa7-41b7-9ea9-dc6633a3cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:41.053502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c620-bfa7-41b7-9ea9-dc6633a3cf90 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:41.054186 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875c620-bfa7-41b7-9ea9-dc6633a3cf90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:41.056114 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875c620-bfa7-41b7-9ea9-dc6633a3cf90 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:41.159694 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1437/2861] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:54:40 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:41.163941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37402b-8bc6-4e51-aed9-57b09aa989b6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:41.176278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37402b-8bc6-4e51-aed9-57b09aa989b6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:41.181018 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670f072-e921-476d-9665-5ab2cb46efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:41.181754 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670f072-e921-476d-9665-5ab2cb46efe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:41.182698 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670f072-e921-476d-9665-5ab2cb46efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:41.182958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670f072-e921-476d-9665-5ab2cb46efe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:41.184160 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670f072-e921-476d-9665-5ab2cb46efe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:41.185761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670f072-e921-476d-9665-5ab2cb46efe7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:41.196194 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1425/2862] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:54:41.200741 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c620-bfa7-41b7-9ea9-dc6633a3cf90 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:41.210853 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c620-bfa7-41b7-9ea9-dc6633a3cf90 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:41.216315 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d36f7-69a3-405b-93b5-60aa12d5d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:41.216959 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d36f7-69a3-405b-93b5-60aa12d5d4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:41.217248 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d36f7-69a3-405b-93b5-60aa12d5d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:41.217524 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d36f7-69a3-405b-93b5-60aa12d5d4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:41.218245 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d36f7-69a3-405b-93b5-60aa12d5d4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:41.219836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d36f7-69a3-405b-93b5-60aa12d5d4ef admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:41.230839 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1438/2863] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:41.235156 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670f072-e921-476d-9665-5ab2cb46efe7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:41.246300 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670f072-e921-476d-9665-5ab2cb46efe7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:41.251065 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b001b-a4f3-4950-9f1e-ae62f13f9b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:41.251944 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b001b-a4f3-4950-9f1e-ae62f13f9b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:41.252264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b001b-a4f3-4950-9f1e-ae62f13f9b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:41.252549 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b001b-a4f3-4950-9f1e-ae62f13f9b00 admin admin] PATH_INFO: `/v3/projects/4bc0baaa00d54b1d822f210185578da5/users/8549b9f277f14551a76858d58f44ce72/roles/14542129036041fa85f7c5223487670d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:41.268675 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b001b-a4f3-4950-9f1e-ae62f13f9b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc0baaa00d54b1d822f210185578da5, user_id=8549b9f277f14551a76858d58f44ce72, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:41.271336 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b001b-a4f3-4950-9f1e-ae62f13f9b00 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:41.409371 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1426/2864] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:54:41 2022] PUT /identity/v3/projects/4bc0baaa00d54b1d822f210185578da5/users/8549b9f277f14551a76858d58f44ce72/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:41.420380 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75d7c3-fb9d-4b24-a1c1-ef28c4bf1e33 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:41.420592 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75d7c3-fb9d-4b24-a1c1-ef28c4bf1e33 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:41.420871 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75d7c3-fb9d-4b24-a1c1-ef28c4bf1e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:41.448774 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-5b75d7c3-fb9d-4b24-a1c1-ef28c4bf1e33 None None] MFA Rules not processed for user `8549b9f277f14551a76858d58f44ce72`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:41.450009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-5b75d7c3-fb9d-4b24-a1c1-ef28c4bf1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:41.495358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:41.518670 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1439/2865] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:41.523146 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b001b-a4f3-4950-9f1e-ae62f13f9b00 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:41.581817 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:41.598888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b001b-a4f3-4950-9f1e-ae62f13f9b00 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:41.603513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103d9af-17f2-4c42-a628-941d62fcfdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:41.604308 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103d9af-17f2-4c42-a628-941d62fcfdae admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:41.604590 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103d9af-17f2-4c42-a628-941d62fcfdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:41.604862 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103d9af-17f2-4c42-a628-941d62fcfdae admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:41.605569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103d9af-17f2-4c42-a628-941d62fcfdae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:41.607441 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103d9af-17f2-4c42-a628-941d62fcfdae admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:41.767828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1427/2866] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:54:41 2022] POST /identity/v3/projects => generated 379 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:41.768939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75d7c3-fb9d-4b24-a1c1-ef28c4bf1e33 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:41.780467 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75d7c3-fb9d-4b24-a1c1-ef28c4bf1e33 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:41.843910 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9780-4071-41e7-ab8b-15fccd28a116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:41.844636 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9780-4071-41e7-ab8b-15fccd28a116 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:41.844923 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9780-4071-41e7-ab8b-15fccd28a116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:41.845235 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9780-4071-41e7-ab8b-15fccd28a116 admin admin] PATH_INFO: `/v3/users` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:41.845939 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db9780-4071-41e7-ab8b-15fccd28a116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:41.847862 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db9780-4071-41e7-ab8b-15fccd28a116 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:41.983538 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1440/2867] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:54:41 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:54:41.987703 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103d9af-17f2-4c42-a628-941d62fcfdae admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:41.999057 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103d9af-17f2-4c42-a628-941d62fcfdae admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:42.003742 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218c6e6-a175-4e2a-adb0-e38befd01170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:42.004451 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218c6e6-a175-4e2a-adb0-e38befd01170 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:42.004726 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218c6e6-a175-4e2a-adb0-e38befd01170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:42.004997 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218c6e6-a175-4e2a-adb0-e38befd01170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:42.005707 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218c6e6-a175-4e2a-adb0-e38befd01170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:42.007374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218c6e6-a175-4e2a-adb0-e38befd01170 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:42.018586 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1428/2868] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:42.022855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9780-4071-41e7-ab8b-15fccd28a116 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:42.033474 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9780-4071-41e7-ab8b-15fccd28a116 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:42.038493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525154a6-2650-4d0f-b848-9788a92348f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:42.039384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525154a6-2650-4d0f-b848-9788a92348f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:42.039668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525154a6-2650-4d0f-b848-9788a92348f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:42.039940 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525154a6-2650-4d0f-b848-9788a92348f8 admin admin] PATH_INFO: `/v3/projects/ee13b65375bb406abb07eb4d5b0b9217/users/6b9985cd18364c95b9525cdae0f7fdcd/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:42.055869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525154a6-2650-4d0f-b848-9788a92348f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee13b65375bb406abb07eb4d5b0b9217, user_id=6b9985cd18364c95b9525cdae0f7fdcd, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:42.059335 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525154a6-2650-4d0f-b848-9788a92348f8 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:42.142471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1441/2869] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:54:42 2022] PUT /identity/v3/projects/ee13b65375bb406abb07eb4d5b0b9217/users/6b9985cd18364c95b9525cdae0f7fdcd/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:54:42.146602 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218c6e6-a175-4e2a-adb0-e38befd01170 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:42.156979 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218c6e6-a175-4e2a-adb0-e38befd01170 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:42.215761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fcea6-e23b-452c-b1c7-2347e896f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:42.216500 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fcea6-e23b-452c-b1c7-2347e896f90d admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:42.216787 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fcea6-e23b-452c-b1c7-2347e896f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:42.217069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fcea6-e23b-452c-b1c7-2347e896f90d admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:42.217796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fcea6-e23b-452c-b1c7-2347e896f90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:42.219388 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fcea6-e23b-452c-b1c7-2347e896f90d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:42.230877 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1429/2870] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:42.235052 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525154a6-2650-4d0f-b848-9788a92348f8 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:42.247277 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525154a6-2650-4d0f-b848-9788a92348f8 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:42.253413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa347c1-f30a-4bc2-977c-341aef11dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:42.254452 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa347c1-f30a-4bc2-977c-341aef11dff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:42.254730 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa347c1-f30a-4bc2-977c-341aef11dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:42.255004 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa347c1-f30a-4bc2-977c-341aef11dff1 admin admin] PATH_INFO: `/v3/projects/ee13b65375bb406abb07eb4d5b0b9217/users/6b9985cd18364c95b9525cdae0f7fdcd/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:42.257072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa347c1-f30a-4bc2-977c-341aef11dff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee13b65375bb406abb07eb4d5b0b9217, user_id=6b9985cd18364c95b9525cdae0f7fdcd, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:42.259736 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa347c1-f30a-4bc2-977c-341aef11dff1 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:42.271322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1442/2871] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:54:42 2022] PUT /identity/v3/projects/ee13b65375bb406abb07eb4d5b0b9217/users/6b9985cd18364c95b9525cdae0f7fdcd/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:42.285275 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84ae7-c317-4b68-abaa-dc2f867e8da6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:42.285569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84ae7-c317-4b68-abaa-dc2f867e8da6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:42.285849 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84ae7-c317-4b68-abaa-dc2f867e8da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:42.314671 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f7a84ae7-c317-4b68-abaa-dc2f867e8da6 None None] MFA Rules not processed for user `6b9985cd18364c95b9525cdae0f7fdcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:42.315909 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f7a84ae7-c317-4b68-abaa-dc2f867e8da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:42.391479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1430/2872] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:42.404288 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa347c1-f30a-4bc2-977c-341aef11dff1 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:42.406048 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-faa347c1-f30a-4bc2-977c-341aef11dff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:42.468292 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa347c1-f30a-4bc2-977c-341aef11dff1 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:42.471965 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4457-0ca9-4a1c-ae9d-1e3dbe762a62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:42.472653 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4457-0ca9-4a1c-ae9d-1e3dbe762a62 service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:42.472941 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4457-0ca9-4a1c-ae9d-1e3dbe762a62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:42.473246 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4457-0ca9-4a1c-ae9d-1e3dbe762a62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:42.482794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b4457-0ca9-4a1c-ae9d-1e3dbe762a62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:42.484253 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b4457-0ca9-4a1c-ae9d-1e3dbe762a62 service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:42.495087 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1443/2873] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:54:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:54:43.574989 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a84ae7-c317-4b68-abaa-dc2f867e8da6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:43.584660 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a84ae7-c317-4b68-abaa-dc2f867e8da6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:43.589510 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dd8b7-99fb-4232-bc9b-44885a0e3646 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9985cd18364c95b9525cdae0f7fdcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee13b65375bb406abb07eb4d5b0b9217', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:43.590187 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dd8b7-99fb-4232-bc9b-44885a0e3646 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:43.590477 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dd8b7-99fb-4232-bc9b-44885a0e3646 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:43.590760 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dd8b7-99fb-4232-bc9b-44885a0e3646 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:43.591492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dd8b7-99fb-4232-bc9b-44885a0e3646 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:54:43.591805 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dd8b7-99fb-4232-bc9b-44885a0e3646 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:43.593447 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dd8b7-99fb-4232-bc9b-44885a0e3646 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:43.606263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1431/2874] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:54:43.610889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4457-0ca9-4a1c-ae9d-1e3dbe762a62 service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:43.620938 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4457-0ca9-4a1c-ae9d-1e3dbe762a62 service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:43.625614 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeacaa8-80d8-48bb-ac3f-165a2e81253b tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9985cd18364c95b9525cdae0f7fdcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee13b65375bb406abb07eb4d5b0b9217', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:43.626268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeacaa8-80d8-48bb-ac3f-165a2e81253b tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:43.626556 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeacaa8-80d8-48bb-ac3f-165a2e81253b tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:43.626836 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeacaa8-80d8-48bb-ac3f-165a2e81253b tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:43.627526 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeacaa8-80d8-48bb-ac3f-165a2e81253b tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:43.629469 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeacaa8-80d8-48bb-ac3f-165a2e81253b tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:43.747782 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1444/2875] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:54:43 2022] POST /identity/v3/projects => generated 354 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:43.752271 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dd8b7-99fb-4232-bc9b-44885a0e3646 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:43.762699 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dd8b7-99fb-4232-bc9b-44885a0e3646 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:43.784298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:43.821149 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffea3c-04ad-4e90-b6ec-70c1c8343f5c tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9985cd18364c95b9525cdae0f7fdcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee13b65375bb406abb07eb4d5b0b9217', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:43.821891 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffea3c-04ad-4e90-b6ec-70c1c8343f5c tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:43.822112 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffea3c-04ad-4e90-b6ec-70c1c8343f5c tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:43.822389 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffea3c-04ad-4e90-b6ec-70c1c8343f5c tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:43.823188 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffea3c-04ad-4e90-b6ec-70c1c8343f5c tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:54:43.823561 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffea3c-04ad-4e90-b6ec-70c1c8343f5c tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:43.825353 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffea3c-04ad-4e90-b6ec-70c1c8343f5c tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:43.838552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1432/2876] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 17:54:43.876322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeacaa8-80d8-48bb-ac3f-165a2e81253b tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:43.886919 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeacaa8-80d8-48bb-ac3f-165a2e81253b tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:43.891693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9985cd18364c95b9525cdae0f7fdcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee13b65375bb406abb07eb4d5b0b9217', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:43.892620 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:43.892911 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:43.893194 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] PATH_INFO: `/v3/projects/08e44bc101134742b2b53db77023182f` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:43.894395 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: Authorizing `identity:delete_project(project_id=08e44bc101134742b2b53db77023182f)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:43.896330 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:43.908349 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:44.049054 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e44bc101134742b2b53db77023182f', 'request_id': 'req-0086b69a-9272-4f5b-8109-417c321e1cb8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:44.054453 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e44bc101134742b2b53db77023182f', 'request_id': 'req-0086b69a-9272-4f5b-8109-417c321e1cb8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:44.061431 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e44bc101134742b2b53db77023182f', 'request_id': 'req-0086b69a-9272-4f5b-8109-417c321e1cb8'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:44.147371 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] The token cache is being invalidate because project 08e44bc101134742b2b53db77023182f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:54:44.147779 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:44.148444 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0086b69a-9272-4f5b-8109-417c321e1cb8 tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:44.150059 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1445/2877] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:54:43 2022] DELETE /identity/v3/projects/08e44bc101134742b2b53db77023182f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:44.879669 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffea3c-04ad-4e90-b6ec-70c1c8343f5c tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:44.882217 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c4ffea3c-04ad-4e90-b6ec-70c1c8343f5c tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:44.952963 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffea3c-04ad-4e90-b6ec-70c1c8343f5c tempest-VolumeQuotaClassesTest-351455487 tempest-VolumeQuotaClassesTest-351455487-project-admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:45.012680 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:45.013569 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:45.013850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:45.014128 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] PATH_INFO: `/v3/users/8549b9f277f14551a76858d58f44ce72` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:45.015328 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8549b9f277f14551a76858d58f44ce72)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:45.017293 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:45.222972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8549b9f277f14551a76858d58f44ce72'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:45.236295 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8549b9f277f14551a76858d58f44ce72'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:45.238821 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:45.342278 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8549b9f277f14551a76858d58f44ce72'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:45.342958 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8549b9f277f14551a76858d58f44ce72'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:45.343580 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8549b9f277f14551a76858d58f44ce72'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:45.357384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1433/2878] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:54:44 2022] DELETE /identity/v3/users/8549b9f277f14551a76858d58f44ce72 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:45.361840 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93756fb5-763e-4441-afce-bbf62c378e29 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:45.362358 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93756fb5-763e-4441-afce-bbf62c378e29 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:45.362492 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93756fb5-763e-4441-afce-bbf62c378e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:45.381027 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-93756fb5-763e-4441-afce-bbf62c378e29 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:45.382263 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-93756fb5-763e-4441-afce-bbf62c378e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:45.443815 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1446/2879] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:45.454102 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:45.455552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:45.513429 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf24f-ad08-401f-b324-590d48e87f05 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:45.516892 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a0279-2f6b-42d4-b98f-d5721a965ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:45.517534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a0279-2f6b-42d4-b98f-d5721a965ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:45.517814 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a0279-2f6b-42d4-b98f-d5721a965ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:45.518086 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a0279-2f6b-42d4-b98f-d5721a965ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:45.527214 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a0279-2f6b-42d4-b98f-d5721a965ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:45.528666 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a0279-2f6b-42d4-b98f-d5721a965ba4 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:45.538154 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1434/2880] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:54:46.021363 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93756fb5-763e-4441-afce-bbf62c378e29 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:46.022799 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-93756fb5-763e-4441-afce-bbf62c378e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:46.035783 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93756fb5-763e-4441-afce-bbf62c378e29 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:46.040566 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:46.047238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:46.047238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:46.047238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] PATH_INFO: `/v3/projects/4bc0baaa00d54b1d822f210185578da5` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:46.047238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc0baaa00d54b1d822f210185578da5)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:46.047238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:46.187239 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc0baaa00d54b1d822f210185578da5', 'request_id': 'req-7a14371a-5d2e-46ba-9e26-feef20942185'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:46.192936 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc0baaa00d54b1d822f210185578da5', 'request_id': 'req-7a14371a-5d2e-46ba-9e26-feef20942185'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:46.199876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc0baaa00d54b1d822f210185578da5', 'request_id': 'req-7a14371a-5d2e-46ba-9e26-feef20942185'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:46.290081 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] The token cache is being invalidate because project 4bc0baaa00d54b1d822f210185578da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:54:46.290316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:46.290866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:46.293321 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1447/2881] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:54:46 2022] DELETE /identity/v3/projects/4bc0baaa00d54b1d822f210185578da5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:46.297507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a0279-2f6b-42d4-b98f-d5721a965ba4 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:46.308852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a0279-2f6b-42d4-b98f-d5721a965ba4 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:46.377067 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:46.377955 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:46.378239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:46.378513 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] PATH_INFO: `/v3/users/6b9985cd18364c95b9525cdae0f7fdcd` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:46.379908 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9985cd18364c95b9525cdae0f7fdcd)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:46.381961 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:46.613479 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9985cd18364c95b9525cdae0f7fdcd'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:46.629374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9985cd18364c95b9525cdae0f7fdcd'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:46.693507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9985cd18364c95b9525cdae0f7fdcd'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:46.694202 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9985cd18364c95b9525cdae0f7fdcd'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:46.695105 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-127f5349-637f-4a94-b6a0-e13be92845d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9985cd18364c95b9525cdae0f7fdcd'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:46.708557 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1435/2882] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:54:46 2022] DELETE /identity/v3/users/6b9985cd18364c95b9525cdae0f7fdcd => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:47.230920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:47.232591 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:47.247572 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14371a-5d2e-46ba-9e26-feef20942185 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:47.268449 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:47.309973 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:47.310837 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:47.311121 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:47.311398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] PATH_INFO: `/v3/projects/ee13b65375bb406abb07eb4d5b0b9217` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:47.312629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee13b65375bb406abb07eb4d5b0b9217)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:47.314553 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:47.444243 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee13b65375bb406abb07eb4d5b0b9217', 'request_id': 'req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:47.450310 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee13b65375bb406abb07eb4d5b0b9217', 'request_id': 'req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:47.456807 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee13b65375bb406abb07eb4d5b0b9217', 'request_id': 'req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:47.510869 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] The token cache is being invalidate because project ee13b65375bb406abb07eb4d5b0b9217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80456) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:54:47.511085 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:47.511695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0bb3e6bf-024d-425c-89a9-4aeb37c927ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:54:47.513303 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1448/2883] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:54:47 2022] DELETE /identity/v3/projects/ee13b65375bb406abb07eb4d5b0b9217 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:47.518844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485c9a-927a-4874-99a1-383e4a626c32 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:47.519357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485c9a-927a-4874-99a1-383e4a626c32 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:47.519357 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485c9a-927a-4874-99a1-383e4a626c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:47.533092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:47.539319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a1485c9a-927a-4874-99a1-383e4a626c32 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:47.540619 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a1485c9a-927a-4874-99a1-383e4a626c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:47.608745 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1436/2884] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 17:54:47.616562 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8198ea-477f-48f1-afff-f62093765768 None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:47.616856 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8198ea-477f-48f1-afff-f62093765768 None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:47.617138 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8198ea-477f-48f1-afff-f62093765768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:47.637083 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-0c8198ea-477f-48f1-afff-f62093765768 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:47.638316 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0c8198ea-477f-48f1-afff-f62093765768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:47.649811 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1449/2885] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:47.651633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1485c9a-927a-4874-99a1-383e4a626c32 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:47.665246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1485c9a-927a-4874-99a1-383e4a626c32 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:47.673689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c09783-e0b5-4533-aca1-cd254ef95ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:47.674374 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09783-e0b5-4533-aca1-cd254ef95ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:47.674939 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09783-e0b5-4533-aca1-cd254ef95ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:47.675060 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09783-e0b5-4533-aca1-cd254ef95ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:47.675734 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c09783-e0b5-4533-aca1-cd254ef95ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 17:54:47.676046 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c09783-e0b5-4533-aca1-cd254ef95ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:47.677800 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c09783-e0b5-4533-aca1-cd254ef95ba3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:47.692140 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1437/2886] 10.222.0.77 () {58 vars in 1152 bytes} [Thu Jun 16 17:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 17:54:47.696806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8198ea-477f-48f1-afff-f62093765768 None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:47.706515 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8198ea-477f-48f1-afff-f62093765768 None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:47.711397 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559726-5261-4663-9bb5-fe253f6a9813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:47.712089 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559726-5261-4663-9bb5-fe253f6a9813 admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:47.712386 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559726-5261-4663-9bb5-fe253f6a9813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:47.712668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559726-5261-4663-9bb5-fe253f6a9813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:47.714058 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559726-5261-4663-9bb5-fe253f6a9813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:47.715974 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559726-5261-4663-9bb5-fe253f6a9813 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:47.823493 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1450/2887] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:54:47 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:47.827794 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c09783-e0b5-4533-aca1-cd254ef95ba3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:47.843993 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c09783-e0b5-4533-aca1-cd254ef95ba3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:47.913458 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69346e-22ce-4f4c-a50f-6119a983181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:47.914169 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69346e-22ce-4f4c-a50f-6119a983181f admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:47.914518 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69346e-22ce-4f4c-a50f-6119a983181f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:47.914792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69346e-22ce-4f4c-a50f-6119a983181f admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:47.915486 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69346e-22ce-4f4c-a50f-6119a983181f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:47.917532 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69346e-22ce-4f4c-a50f-6119a983181f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:48.011588 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1438/2888] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:54:47 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:48.016001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559726-5261-4663-9bb5-fe253f6a9813 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:48.027687 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559726-5261-4663-9bb5-fe253f6a9813 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:48.032511 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679eb95-071a-41a7-a1f1-f8c1420c4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:48.033170 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679eb95-071a-41a7-a1f1-f8c1420c4f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:48.033460 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679eb95-071a-41a7-a1f1-f8c1420c4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:48.033743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679eb95-071a-41a7-a1f1-f8c1420c4f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:48.034479 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679eb95-071a-41a7-a1f1-f8c1420c4f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:48.036105 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679eb95-071a-41a7-a1f1-f8c1420c4f00 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:48.049578 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1451/2889] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:48.054115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69346e-22ce-4f4c-a50f-6119a983181f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:48.064840 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69346e-22ce-4f4c-a50f-6119a983181f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:48.069627 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446ce05-bf5d-4b3f-afad-c4d3db127d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:48.070298 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446ce05-bf5d-4b3f-afad-c4d3db127d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:48.070576 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446ce05-bf5d-4b3f-afad-c4d3db127d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:48.070846 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446ce05-bf5d-4b3f-afad-c4d3db127d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:48.071597 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446ce05-bf5d-4b3f-afad-c4d3db127d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:48.074069 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446ce05-bf5d-4b3f-afad-c4d3db127d80 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:48.084689 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1439/2890] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:48.089776 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679eb95-071a-41a7-a1f1-f8c1420c4f00 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:48.099982 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679eb95-071a-41a7-a1f1-f8c1420c4f00 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:48.104804 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6ea39-1e12-4fb8-a16f-a78eb4febd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:48.105695 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6ea39-1e12-4fb8-a16f-a78eb4febd52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:48.105975 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6ea39-1e12-4fb8-a16f-a78eb4febd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:48.106249 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6ea39-1e12-4fb8-a16f-a78eb4febd52 admin admin] PATH_INFO: `/v3/projects/a59d8176c87b4fd2b5a38df1003444b5/users/0548760143064a88919f2acd74dd8d85/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:48.121649 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6ea39-1e12-4fb8-a16f-a78eb4febd52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59d8176c87b4fd2b5a38df1003444b5, user_id=0548760143064a88919f2acd74dd8d85, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:48.124320 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6ea39-1e12-4fb8-a16f-a78eb4febd52 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:48.280773 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1452/2891] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:54:48 2022] PUT /identity/v3/projects/a59d8176c87b4fd2b5a38df1003444b5/users/0548760143064a88919f2acd74dd8d85/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:48.291850 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae87745-0004-44d0-8cd4-a33245d16fb8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:48.292233 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae87745-0004-44d0-8cd4-a33245d16fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:48.292595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae87745-0004-44d0-8cd4-a33245d16fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:48.321384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bae87745-0004-44d0-8cd4-a33245d16fb8 None None] MFA Rules not processed for user `0548760143064a88919f2acd74dd8d85`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:48.338938 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bae87745-0004-44d0-8cd4-a33245d16fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:48.400835 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1440/2892] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:48.405440 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6ea39-1e12-4fb8-a16f-a78eb4febd52 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:48.456530 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:48.470072 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6ea39-1e12-4fb8-a16f-a78eb4febd52 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:48.475006 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315adc3d-fa06-4965-9620-54a999ed444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:48.475690 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315adc3d-fa06-4965-9620-54a999ed444e admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:48.475953 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315adc3d-fa06-4965-9620-54a999ed444e admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:48.476262 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315adc3d-fa06-4965-9620-54a999ed444e admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:48.476956 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315adc3d-fa06-4965-9620-54a999ed444e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:48.478931 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315adc3d-fa06-4965-9620-54a999ed444e admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:48.591427 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1453/2893] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:54:48 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:48.594506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae87745-0004-44d0-8cd4-a33245d16fb8 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:48.600384 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:48.607210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae87745-0004-44d0-8cd4-a33245d16fb8 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:48.678534 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e6812-7fdb-4a6d-af7f-cf6730eaaac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:48.679218 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e6812-7fdb-4a6d-af7f-cf6730eaaac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:48.679498 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e6812-7fdb-4a6d-af7f-cf6730eaaac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:48.679776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e6812-7fdb-4a6d-af7f-cf6730eaaac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:48.680499 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e6812-7fdb-4a6d-af7f-cf6730eaaac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:48.683420 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e6812-7fdb-4a6d-af7f-cf6730eaaac4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:48.815443 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1441/2894] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:54:48 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:48.816716 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315adc3d-fa06-4965-9620-54a999ed444e admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:48.828130 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315adc3d-fa06-4965-9620-54a999ed444e admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:48.833012 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337d3e4-58a9-421d-8aa5-3dbccaef044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:48.833693 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337d3e4-58a9-421d-8aa5-3dbccaef044a admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:48.833979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337d3e4-58a9-421d-8aa5-3dbccaef044a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:48.834291 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337d3e4-58a9-421d-8aa5-3dbccaef044a admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:48.835146 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337d3e4-58a9-421d-8aa5-3dbccaef044a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:48.836806 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337d3e4-58a9-421d-8aa5-3dbccaef044a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:48.852424 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1454/2895] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:48.854066 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e6812-7fdb-4a6d-af7f-cf6730eaaac4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:48.864998 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e6812-7fdb-4a6d-af7f-cf6730eaaac4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:48.871192 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d8896-ad93-454f-9777-1ea26fdd97dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:48.871879 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8896-ad93-454f-9777-1ea26fdd97dc admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:48.872210 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8896-ad93-454f-9777-1ea26fdd97dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:48.872495 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8896-ad93-454f-9777-1ea26fdd97dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:48.873244 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d8896-ad93-454f-9777-1ea26fdd97dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:48.874912 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d8896-ad93-454f-9777-1ea26fdd97dc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:48.886604 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1442/2896] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:48.890955 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337d3e4-58a9-421d-8aa5-3dbccaef044a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:48.902127 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337d3e4-58a9-421d-8aa5-3dbccaef044a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:48.906889 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9af65f-6e19-473e-b5f1-1817a09ba7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:48.907801 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af65f-6e19-473e-b5f1-1817a09ba7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:48.908111 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af65f-6e19-473e-b5f1-1817a09ba7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:48.908399 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af65f-6e19-473e-b5f1-1817a09ba7c5 admin admin] PATH_INFO: `/v3/projects/64b1d681df6e4403856184640afa3fe7/users/f146fc73349545ea81a260e5bc06879b/roles/14542129036041fa85f7c5223487670d` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:48.925283 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9af65f-6e19-473e-b5f1-1817a09ba7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b1d681df6e4403856184640afa3fe7, user_id=f146fc73349545ea81a260e5bc06879b, role_id=14542129036041fa85f7c5223487670d)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:48.927920 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9af65f-6e19-473e-b5f1-1817a09ba7c5 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:49.026937 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1455/2897] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:54:48 2022] PUT /identity/v3/projects/64b1d681df6e4403856184640afa3fe7/users/f146fc73349545ea81a260e5bc06879b/roles/14542129036041fa85f7c5223487670d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 17:54:49.038751 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737bb19-d745-4b66-9985-9d7a95eb0dde None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:49.039040 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737bb19-d745-4b66-9985-9d7a95eb0dde None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:49.039319 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737bb19-d745-4b66-9985-9d7a95eb0dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:49.068903 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6737bb19-d745-4b66-9985-9d7a95eb0dde None None] MFA Rules not processed for user `f146fc73349545ea81a260e5bc06879b`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:49.070133 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6737bb19-d745-4b66-9985-9d7a95eb0dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:49.141165 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1443/2898] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:49.145714 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9af65f-6e19-473e-b5f1-1817a09ba7c5 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:49.215268 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9af65f-6e19-473e-b5f1-1817a09ba7c5 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:49.223401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce8b29-f7b8-4283-a332-72b4bf7cf9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:49.223401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8b29-f7b8-4283-a332-72b4bf7cf9ec admin admin] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:49.223401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8b29-f7b8-4283-a332-72b4bf7cf9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:49.223401 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8b29-f7b8-4283-a332-72b4bf7cf9ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:49.230471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce8b29-f7b8-4283-a332-72b4bf7cf9ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:49.230471 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce8b29-f7b8-4283-a332-72b4bf7cf9ec admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:49.313226 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1456/2899] 10.222.0.77 () {60 vars in 1152 bytes} [Thu Jun 16 17:54:49 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 17:54:49.317137 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737bb19-d745-4b66-9985-9d7a95eb0dde None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:49.328587 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737bb19-d745-4b66-9985-9d7a95eb0dde None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:49.388670 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663455db-04e2-4f8a-ba8e-9fb3f1ea76b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:49.389354 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663455db-04e2-4f8a-ba8e-9fb3f1ea76b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:49.389642 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663455db-04e2-4f8a-ba8e-9fb3f1ea76b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:49.389923 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663455db-04e2-4f8a-ba8e-9fb3f1ea76b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:49.390659 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663455db-04e2-4f8a-ba8e-9fb3f1ea76b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:49.392682 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663455db-04e2-4f8a-ba8e-9fb3f1ea76b7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:49.471829 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:49.477134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1444/2900] 10.222.0.77 () {60 vars in 1143 bytes} [Thu Jun 16 17:54:49 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 17:54:49.481575 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce8b29-f7b8-4283-a332-72b4bf7cf9ec admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:49.492167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce8b29-f7b8-4283-a332-72b4bf7cf9ec admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:49.497373 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce694c-d1c5-4f7d-9909-055c18bc6e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:49.498070 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce694c-d1c5-4f7d-9909-055c18bc6e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:49.498357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce694c-d1c5-4f7d-9909-055c18bc6e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:49.498662 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce694c-d1c5-4f7d-9909-055c18bc6e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:49.499398 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce694c-d1c5-4f7d-9909-055c18bc6e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:49.501076 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce694c-d1c5-4f7d-9909-055c18bc6e0a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:49.513344 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1457/2901] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 17:54:49.517960 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663455db-04e2-4f8a-ba8e-9fb3f1ea76b7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:49.529239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663455db-04e2-4f8a-ba8e-9fb3f1ea76b7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:49.538899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c5384-87f3-4eab-9433-9c6aaee4feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:49.538899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c5384-87f3-4eab-9433-9c6aaee4feb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:49.538899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c5384-87f3-4eab-9433-9c6aaee4feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:49.538899 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c5384-87f3-4eab-9433-9c6aaee4feb1 admin admin] PATH_INFO: `/v3/projects/561ea654b3c64bd88740bd3029d74157/users/bf529c9432864690911c566aec09ee30/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:49.551776 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c5384-87f3-4eab-9433-9c6aaee4feb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561ea654b3c64bd88740bd3029d74157, user_id=bf529c9432864690911c566aec09ee30, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:49.554507 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c5384-87f3-4eab-9433-9c6aaee4feb1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:49.711135 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1445/2902] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:54:49 2022] PUT /identity/v3/projects/561ea654b3c64bd88740bd3029d74157/users/bf529c9432864690911c566aec09ee30/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:49.716205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce694c-d1c5-4f7d-9909-055c18bc6e0a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:49.727384 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce694c-d1c5-4f7d-9909-055c18bc6e0a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:49.787674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3535f-80d7-447c-82bc-3cfa03d19a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:49.788435 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3535f-80d7-447c-82bc-3cfa03d19a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:49.788724 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3535f-80d7-447c-82bc-3cfa03d19a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:49.789001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3535f-80d7-447c-82bc-3cfa03d19a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:49.789725 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3535f-80d7-447c-82bc-3cfa03d19a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:49.791383 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3535f-80d7-447c-82bc-3cfa03d19a74 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:49.802322 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1458/2903] 10.222.0.77 () {58 vars in 1121 bytes} [Thu Jun 16 17:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 17:54:49.807161 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c5384-87f3-4eab-9433-9c6aaee4feb1 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:49.818414 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c5384-87f3-4eab-9433-9c6aaee4feb1 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:49.823996 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a6520-b259-4705-8858-bfd3e7edacd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:49.824972 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a6520-b259-4705-8858-bfd3e7edacd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:49.825261 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a6520-b259-4705-8858-bfd3e7edacd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:49.825540 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a6520-b259-4705-8858-bfd3e7edacd6 admin admin] PATH_INFO: `/v3/projects/561ea654b3c64bd88740bd3029d74157/users/bf529c9432864690911c566aec09ee30/roles/5e1acfd8acd8439fb83cf43ffc4d1984` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:49.827683 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a6520-b259-4705-8858-bfd3e7edacd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561ea654b3c64bd88740bd3029d74157, user_id=bf529c9432864690911c566aec09ee30, role_id=5e1acfd8acd8439fb83cf43ffc4d1984)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:49.830369 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a6520-b259-4705-8858-bfd3e7edacd6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:49.841583 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1446/2904] 10.222.0.77 () {60 vars in 1482 bytes} [Thu Jun 16 17:54:49 2022] PUT /identity/v3/projects/561ea654b3c64bd88740bd3029d74157/users/bf529c9432864690911c566aec09ee30/roles/5e1acfd8acd8439fb83cf43ffc4d1984 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:54:49.852385 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e507d-fc2f-4a88-ba72-9196d1ea247d None None] REQUEST_METHOD: `POST` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:49.852677 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e507d-fc2f-4a88-ba72-9196d1ea247d None None] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:49.852960 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e507d-fc2f-4a88-ba72-9196d1ea247d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:49.874997 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:54:49.884374 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.auth.core [None req-9f8e507d-fc2f-4a88-ba72-9196d1ea247d None None] MFA Rules not processed for user `bf529c9432864690911c566aec09ee30`. Rule list: `[]` (Enabled: `True`). {{(pid=80456) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:54:49.885855 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9f8e507d-fc2f-4a88-ba72-9196d1ea247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:49.968476 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1459/2905] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:54:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:54:49.979505 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a6520-b259-4705-8858-bfd3e7edacd6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:49.981283 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2a6a6520-b259-4705-8858-bfd3e7edacd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:50.044492 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a6520-b259-4705-8858-bfd3e7edacd6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:50.048445 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41cb84-ee2a-494c-888b-7a4af3e6d170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:50.049092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41cb84-ee2a-494c-888b-7a4af3e6d170 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:50.049375 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41cb84-ee2a-494c-888b-7a4af3e6d170 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:50.049644 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41cb84-ee2a-494c-888b-7a4af3e6d170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:50.060844 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41cb84-ee2a-494c-888b-7a4af3e6d170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:50.062290 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41cb84-ee2a-494c-888b-7a4af3e6d170 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:50.074387 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1447/2906] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:54:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:54:51.319568 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e507d-fc2f-4a88-ba72-9196d1ea247d None None] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:51.321038 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-9f8e507d-fc2f-4a88-ba72-9196d1ea247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:54:51.333250 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e507d-fc2f-4a88-ba72-9196d1ea247d None None] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:51.336820 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22082-8295-4324-879c-08ee96e5ce9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:51.337489 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22082-8295-4324-879c-08ee96e5ce9a service cinder] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:51.338323 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22082-8295-4324-879c-08ee96e5ce9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:51.338635 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d22082-8295-4324-879c-08ee96e5ce9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:51.395668 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d22082-8295-4324-879c-08ee96e5ce9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:51.397241 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d22082-8295-4324-879c-08ee96e5ce9a service cinder] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:51.407084 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1460/2907] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:54:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:54:56.533595 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41cb84-ee2a-494c-888b-7a4af3e6d170 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:54:56.543011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41cb84-ee2a-494c-888b-7a4af3e6d170 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:54:56.546778 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3197cf-49cf-465a-a087-d8f5a5b249a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf46b0ab3b9400d8fc44ba3a1574f27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:54:56.547449 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3197cf-49cf-465a-a087-d8f5a5b249a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:54:56.547719 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3197cf-49cf-465a-a087-d8f5a5b249a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:54:56.548011 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3197cf-49cf-465a-a087-d8f5a5b249a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:54:56.613852 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3197cf-49cf-465a-a087-d8f5a5b249a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:54:56.615322 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3197cf-49cf-465a-a087-d8f5a5b249a8 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:54:56.626930 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1448/2908] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:54:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:55:01.247631 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22082-8295-4324-879c-08ee96e5ce9a service cinder] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:55:01.319756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d22082-8295-4324-879c-08ee96e5ce9a service cinder] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:55:01.326007 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:55:01.326898 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:55:01.327183 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:55:01.327459 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] PATH_INFO: `/v3/users/0548760143064a88919f2acd74dd8d85` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:55:01.328701 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0548760143064a88919f2acd74dd8d85)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:55:01.330647 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:55:01.598756 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:55:01.608927 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0548760143064a88919f2acd74dd8d85'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:01.621802 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0548760143064a88919f2acd74dd8d85'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:01.729876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0548760143064a88919f2acd74dd8d85'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:01.731165 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0548760143064a88919f2acd74dd8d85'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:01.732159 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0548760143064a88919f2acd74dd8d85'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:01.746233 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1461/2909] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:55:01 2022] DELETE /identity/v3/users/0548760143064a88919f2acd74dd8d85 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:55:01.750761 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2eea5-02b1-40dd-adf2-dfe102d70461 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:55:01.751266 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2eea5-02b1-40dd-adf2-dfe102d70461 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:55:01.751394 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2eea5-02b1-40dd-adf2-dfe102d70461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:55:01.769866 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b4c2eea5-02b1-40dd-adf2-dfe102d70461 None None] MFA Rules not processed for user `a30ed168831044238fab0d0dd5d1bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 17:55:01.771106 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b4c2eea5-02b1-40dd-adf2-dfe102d70461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:55:01.835861 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1449/2910] 10.222.0.77 () {58 vars in 957 bytes} [Thu Jun 16 17:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 17:55:01.846494 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:55:01.847922 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:55:01.919001 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd1439-db3f-42eb-924d-b904cb55e023 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:55:01.922843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70fd03-506a-4aa7-8ad1-ab83ba94037e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19ce01cdbd8d4ac9bb126a6814f2d13b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:55:01.923506 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70fd03-506a-4aa7-8ad1-ab83ba94037e service neutron] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:55:01.923794 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70fd03-506a-4aa7-8ad1-ab83ba94037e service neutron] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:55:01.924088 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70fd03-506a-4aa7-8ad1-ab83ba94037e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:55:01.934876 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70fd03-506a-4aa7-8ad1-ab83ba94037e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:55:01.936790 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70fd03-506a-4aa7-8ad1-ab83ba94037e service neutron] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:55:01.947229 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1462/2911] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:55:02.433552 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2eea5-02b1-40dd-adf2-dfe102d70461 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:55:02.435332 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b4c2eea5-02b1-40dd-adf2-dfe102d70461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:55:02.445246 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:55:02.459239 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2eea5-02b1-40dd-adf2-dfe102d70461 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:55:02.465268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:55:02.465268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:55:02.465268 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:55:02.465531 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] PATH_INFO: `/v3/projects/a59d8176c87b4fd2b5a38df1003444b5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:55:02.466792 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59d8176c87b4fd2b5a38df1003444b5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:55:02.468796 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:55:02.603401 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59d8176c87b4fd2b5a38df1003444b5', 'request_id': 'req-5fc218e9-473e-41b4-b623-5a2395f63356'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:02.609398 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59d8176c87b4fd2b5a38df1003444b5', 'request_id': 'req-5fc218e9-473e-41b4-b623-5a2395f63356'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:02.718008 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59d8176c87b4fd2b5a38df1003444b5', 'request_id': 'req-5fc218e9-473e-41b4-b623-5a2395f63356'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:02.733403 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] The token cache is being invalidate because project a59d8176c87b4fd2b5a38df1003444b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:55:02.735372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:02.735372 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:02.735888 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1450/2912] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:55:02 2022] DELETE /identity/v3/projects/a59d8176c87b4fd2b5a38df1003444b5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:55:02.739880 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70fd03-506a-4aa7-8ad1-ab83ba94037e service neutron] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:55:02.751533 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70fd03-506a-4aa7-8ad1-ab83ba94037e service neutron] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:55:02.815674 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:55:02.816634 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:55:02.816926 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:55:02.817205 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] PATH_INFO: `/v3/users/f146fc73349545ea81a260e5bc06879b` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:55:02.818400 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f146fc73349545ea81a260e5bc06879b)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:55:02.820360 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:55:03.060014 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f146fc73349545ea81a260e5bc06879b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:03.067336 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:55:03.072746 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f146fc73349545ea81a260e5bc06879b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:03.175113 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f146fc73349545ea81a260e5bc06879b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:03.175895 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f146fc73349545ea81a260e5bc06879b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:03.176727 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f146fc73349545ea81a260e5bc06879b'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:03.190497 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1463/2913] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:55:02 2022] DELETE /identity/v3/users/f146fc73349545ea81a260e5bc06879b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:55:03.675292 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:55:03.677452 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:55:03.694263 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc218e9-473e-41b4-b623-5a2395f63356 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:55:03.758619 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:55:03.759506 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:55:03.759790 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:55:03.760092 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] PATH_INFO: `/v3/projects/64b1d681df6e4403856184640afa3fe7` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:55:03.761307 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b1d681df6e4403856184640afa3fe7)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:55:03.763916 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:55:03.916243 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b1d681df6e4403856184640afa3fe7', 'request_id': 'req-974344f3-bfad-43c2-ae9b-07c503670490'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:03.923750 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b1d681df6e4403856184640afa3fe7', 'request_id': 'req-974344f3-bfad-43c2-ae9b-07c503670490'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:04.018633 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b1d681df6e4403856184640afa3fe7', 'request_id': 'req-974344f3-bfad-43c2-ae9b-07c503670490'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:04.031828 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] The token cache is being invalidate because project 64b1d681df6e4403856184640afa3fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:55:04.032138 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:04.032813 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:04.034373 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1451/2914] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:55:03 2022] DELETE /identity/v3/projects/64b1d681df6e4403856184640afa3fe7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:55:04.038629 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:55:04.040125 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:55:04.053314 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea692eac-196d-469f-8002-960f01708f1a admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:55:04.114502 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:55:04.115413 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:55:04.115698 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:55:04.115979 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] PATH_INFO: `/v3/users/bf529c9432864690911c566aec09ee30` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:55:04.117357 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf529c9432864690911c566aec09ee30)` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:55:04.119328 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:55:04.356929 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf529c9432864690911c566aec09ee30'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:04.370378 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf529c9432864690911c566aec09ee30'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:04.453009 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf529c9432864690911c566aec09ee30'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:04.453638 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf529c9432864690911c566aec09ee30'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:04.454238 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.notifications [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf529c9432864690911c566aec09ee30'} {{(pid=80456) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:04.467866 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1464/2915] 10.222.0.77 () {58 vars in 1223 bytes} [Thu Jun 16 17:55:04 2022] DELETE /identity/v3/users/bf529c9432864690911c566aec09ee30 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:55:04.885694 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:55:04.887494 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:55:04.905264 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974344f3-bfad-43c2-ae9b-07c503670490 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:55:04.919885 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:55:04.967115 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a30ed168831044238fab0d0dd5d1bd65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c79ada12a254f71981d5de110c2a5b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:55:04.968006 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:55:04.968320 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:55:04.968593 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] PATH_INFO: `/v3/projects/561ea654b3c64bd88740bd3029d74157` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:55:04.969812 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561ea654b3c64bd88740bd3029d74157)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:55:04.972358 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:55:05.101327 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561ea654b3c64bd88740bd3029d74157', 'request_id': 'req-96949254-bcb0-4d77-bbae-de928e6c9171'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:05.106941 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561ea654b3c64bd88740bd3029d74157', 'request_id': 'req-96949254-bcb0-4d77-bbae-de928e6c9171'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:05.198206 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561ea654b3c64bd88740bd3029d74157', 'request_id': 'req-96949254-bcb0-4d77-bbae-de928e6c9171'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:05.216524 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] The token cache is being invalidate because project 561ea654b3c64bd88740bd3029d74157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 17:55:05.216881 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:05.217571 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-96949254-bcb0-4d77-bbae-de928e6c9171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 17:55:05.219134 dv-cinder-837546-2-smb devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1452/2916] 10.222.0.77 () {58 vars in 1232 bytes} [Thu Jun 16 17:55:04 2022] DELETE /identity/v3/projects/561ea654b3c64bd88740bd3029d74157 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 17:55:14.463743 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=62,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:55:15.211605 dv-cinder-837546-2-smb devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:34.609423 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] Authenticating user token {{(pid=80456) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 17:58:34.610843 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:58:34.681293 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a3fec-e814-47e7-bba9-e74aee8e0a48 admin admin] Validating token access rules against request {{(pid=80456) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 17:58:34.743447 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87629c-53ff-4288-9356-3f1ec6d82ec1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2909d4015ac45fcaf6d1fc8e488aa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e31fda51efda44ff801368222163cc09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80456) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 17:58:34.744167 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87629c-53ff-4288-9356-3f1ec6d82ec1 service placement] REQUEST_METHOD: `GET` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 17:58:34.744499 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87629c-53ff-4288-9356-3f1ec6d82ec1 service placement] SCRIPT_NAME: `/identity` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 17:58:34.744800 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87629c-53ff-4288-9356-3f1ec6d82ec1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80456) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 17:58:34.746570 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.fernet_utils [None req-8a87629c-53ff-4288-9356-3f1ec6d82ec1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80456) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 17:58:34.758865 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87629c-53ff-4288-9356-3f1ec6d82ec1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 17:58:34.760590 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87629c-53ff-4288-9356-3f1ec6d82ec1 service placement] RBAC: Authorization granted {{(pid=80456) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 17:58:34.771728 dv-cinder-837546-2-smb devstack@keystone.service[80456]: [pid: 80456|app: 0|req: 1465/2917] 10.222.0.77 () {60 vars in 1365 bytes} [Thu Jun 16 17:58:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 17:58:44.767436 dv-cinder-837546-2-smb devstack@keystone.service[80456]: DEBUG dbcounter [-] [80456] Writing DB stats keystone:SELECT=58 {{(pid=80456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}